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The Michiaan Pesearch and Development Utilization 
fPDO) proiect set out to increase the appropiate use of the 
educational products of funded research and development by local 
school personnel. The rroject's approach used and fostered the 
improvement of existing organizational and communication networks 
rather^ than attemp+.ina to establish new channels or introduce new 
participants, (This approach was selected for the additional purpose 
of strengt henincr Michigan's career education planning districts in 
their efforts to establish career education programming.) Results of 
the proiect include the implementation of career education products 
in fcrty-«=ix of Michigan's school districts and increased use of the 
project's problem-sol vina perspective. The four reports presented in 
this paper discuss the outcomes of the Michigan EDU project from four 
points of view: (^) observed effects across local schools of a 
state-initiated chanae process: ^2) the expectations the individuals 
who played formal linkage roles had for themselves and tiieir 
a<=;sessment s of the levels of the skills they possessed and would need 
to carry out these roles: (3) the views of the school staffs in the 
forty-six school sites regarding the components of the Michigan RDU 
process: and (^) the observed effects of the PDU product 
implementation in school sites. An appendix lists the locations in 
Michiaan where the best of the implemented products have been placed 
for further review and use by school people. (KC) 
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The Michigan RDU project set out to increase the n]3propriate use of 
the educational products of funded research and developn^ent by local sch.ool 
people. The project's approach u:-:ad and fos:tcred the inpruvc^ent of ex?'KL- 
ing organixatior.al and c:n:;:nunlca t ion networks rather than aL: teiiiotlnr'^ to e5;rab- 
lish new channels or introduce ne\: participants. The project selected thi-. 
approach since it had the additional intention of strem; tliening the capa.cicv 
of Michigan^ s career cducaciou planning dl,^;tricts to provide technJca] as^^ist- 
ance and leadership to local school districts in their efforts to establisii 
career education programming. 

In 1974 Michigan's Legislature established the requirement that all local 
and inter:ricdi.atc school districcs begin planning for the integration of 
career education into their curricula and educational service efforts. The 
RDU project afforded the State DeparL:nent of ]• ducat ion the opportunity to 
support these planning activities in a pilot effort. It also afforded the 
Departinent tl:e unusual luxury of CMamining the entire process vii-.h a nev 
level of thoroughness. The resultjng information could be used to improve 
the Depar tneiit ' s disseninatioii and technical assistance efforts not only in 
career education, but also in subject matter areas and school support areas 
such as nutrition, safety, and transportation. 

Michigan also h.^d tlic advantage of operating a state dissemination capacity 
building project. Th.is project, v;hich v/as also administered by the KilU project 
director, v/as inter.rlod to increase the degree to v/hich school people turn to 
formal inf orip.at ion sources rather r.han remain soleJy dependent upon associates 
and other informal i-iurces. The project set as its goal the increase in use 
of the resources av ailable chrough intermediate, regional, state, and nati' nnl 
information bases. The Capacity RuiJding project complencnt'-d the ilDU project 
by strengthening v\ic rc^-mirce search and acquisition systOTis available-: to 
school people. The Department's approach to dissemination capacity building 
was similar to the RDU ' s . The Department would strengthen the existing sy:.i:cm 
of linkages among providers ratlier than create eitb.er a iiev netv/ork or a 
new resource base. 

The consequence of tbiis strengthening rather than devclopmenta] approach 
vac the- IIDU project's dependence upon the rcco:.;nition und acceptance by the 
individuals and institutions in-rolvcd in career edu.*aticn of tlie fit of th.ci 
RDU project's purpoi:es and operational require:::ents withiin tiieir organizational 
and va].ue structures. Tlie four rej3.;n'ts pres.ented here discuss the outcomes 
of the Mich.igrin RDU project frotn four points of vlrr^r: 

1. Observed effects across ]oca] schools of a state initiated cb.an.g.c 
{process . 

2. The expoel at ions the individu-ils v;ho [)I'iyed formal ]inlr-'-e roles 

for thcri-e] ves and their as; es -.[-ent; :; o\ l\\c. levels of the skilis L.iu.v 
po ssc : ; sod a lui -n ! u < • e^' f e c 'm"r ^- n\' [ ' ; .e ■: , - r(]i'\. 

3. The vjew5: of the scher'l r;r^rfs in the AO scii.^o] sites regarding tiiu 
coii\ponf .n L S C't tl-.- /'jO:i:,e:r: K;'!.' pl-OC'.e;S. 



A* The observed effects of the RDU produci: inplemeatations in sehool 
sites* 

Overall, the following conc:lusionr> uay be drnvn: 

Detailed elar if ication of specific purposes and expectations is 
needed when a new decision-making approacli with attendant role 
ciianges is promoted for school adoption. 

2. Resources must be available at the initiation and during the follov/- 
through of the change process, 

3, The operational definition of linkage must suit the specific organ- 
i za t ional '^.nv ironnr.ent . 

A. School personnel training and technical a^:sistance is needed in 
the implementation stage of R D utilization as well as during 
the problem-solving stage* 

5* There was spill-over of the problem-solving approach into curricula 
areas beyond career education and adoption of the process by 
teachers and administrators whovrerenot formally part of the project 
effort * 

6. Schools will search through and make use of existing R&D pro- 
ducts. However, over-emphasis on the formal search and selection 
process can lessen teachers* and administrators' enthusiasm for the 
products and may push thenn to more traditional, less taxing cur- 
riculum development efforts. 

The text of the report is supplemented by an appendix v;]iich lists 
tiie locations in Michigan where the best of tlie implemented products have 
been placed for further review and use by school people. 

Two results of the project are the reported implementations of career 
education products in forty- six of Michigan's school districts and the problem 
solving perspective that appears to have taken iiold in these schools. Other 
results of the project are the products which are nov; being distributed to 
educators in Michigan and across the country as well as to the National 
Institute of I-^ducation, These products are: .^"^J^^^^ V'^Jlt^i^^ ^'.^^15.' .-;\_.^.^"' V^'^'j ^'^^„ 
^^-^.Ll.^ A 1 1: a in i n g Coals; Problem- Sol vi ng VJ ork ^iur.^'^ : A Tra i" nor ' s Gu ide ; B j a : • 

y^yy I ProrecUi re : :\ l^r oc^oci 1 1 r e 1" or I )e t ee 1 1 n ^: a nd _DcK'u::;ent : n'V. Sex !\ace anji 

0_lj^j,'j Vj i 1 ^^es_ rn jid_nc^iJ:_jj2_nji_l_J-I<;i t er i.i ! s ; j:;^o2'ii ^ ^IJ* * J'LL^Jl J'-^L^^'" f' ^ J 'i.^ ^ ^ ^-_L jIiU'-"' 

a : ;:_d l ■ r v i i " -j ^1 r j o p ie: A C,[[ i de to r.du cat i on « j_ l_ _ i \c^< ^ rn ' ^ Liili 'ilL-^L ' 'i^ * ' y * ^ ' 

P r_i K-ij :y L ! c . 

Additional products cint tiic: evaluation (!c»c'ir..:L':U s pi'odnced l/v the 
S t : o p e rd i \ c at i o n a 1 R e ^; l' a r c h Vo \ i r. d a t i o n . I'l i e s l* h a ^' t_' ! ^ e . ' n yr o v i ci c: d l o A. b t 
A^>;:'''"C i a L * as I'equired by the Mat ion a! I n."-; t i t u t f i-diwa L h>n . These Joeu- 
i:t.-nLs invhui^': site rase stiii!iej^; prob/itin id en L i f i\:a I i m , :;o]uii(Mi, and 
i i n I ■ 1 1 i <. ^ a r u [ » r. r t ; a i u i c r o s; s i I e a n;" 1 y ^; t ■ ; . 
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CEDISS Cross-Site Analysis 



^ • Which school and school district conditions are most associated 
with successful soiution of scnooi probleins? 

In answering this question, using data from the case studies, we kept 
in mind the probability that no one set of conditions is going to interact 
in a uniforrn manner to create a positive atmosphere for local problem sclvina. 
Also, different conditions appeared to be more or less Important, depending 
on the nature of the problem to be solved. Nonetheless, the following 
conditions were found generally to affect solution of local problems: 

a. The organizational environment . The organizational environment in- 
cluded strong wel 1 -respectea leadership close to, or within the site of 
the project; a general atmosphere of support for innovative activities; 
enough autonomy for participating teachers so that they can adapt 
problem solutions to their classroom needs; and clearly dtfined 

role expectations and responsibilities for actors Involved in 
problem solving. One finding from a number of our sites, for 
example, was that there did not need to be widespread participa- 
tion in early decision-making about problem solving/solution 
selection in CEPISS sites, because pre-defined roles led naturally 
to particular actors involving themselves in particular decisions. 
In Rolling Rock, delegation of responsibilities by a site coordina- 
tor led to failure to get the project off the ground because there 
was no authority or personal stature vested in the substitute 
coordinator — people simply ignored him. In Treeline, a recent 
history of innovation-overload led to wariness and skepticism of 
CEDISS, and half-hearted participation by at least one of three 
teachers involved. But in Bayfield and Penton, clear lines of 
authority and widely respected leadership led to sustained progress 
through the course of a project, particularly from initiation into 
impl ementation . 

b. Precedents . Precedents include no negative recent history with 
attempts to solve the problem under consideration; pre-project 
relationships among participants; pre-existing decision-making 
and communications patterns; and pre-existing values held by 
participants and brought to bear on the tasks of the project. 
None of the project sites had any particularly strong negative 
history with career education. Nonetheless, there was in a number 
of sites a widespread lack of understanding of the goals and 
strategies of career education among the general teaching staff 

of the district and most central administrators. This low level 
of consciousness contributed to a very focused, small-scale 
implementation effort in CEDISS, since at most sites only a few 
teachers were interested in implementing a career education product 
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(Pentcn was an exception). CEDISS had little effect, then, on 
pre-existing decision .making and corxnuni cations patterns at all 
sites. But pre-project oatterns served to provide a process for 
getting the project initiated and into full gear. In Bayfield, 
for exanple, participants expressed satisfaction with pre-existing 
relationships, roles, and probl em-sol vi nn processes^-there was no 
locally perceived need for chanqe. One of the clearest conclu- 
sions from the case studies of CEDISS sites was the necessity for 
the state to take into account and respect the legitimacy of pre- 
existing values, relaiicnsriips and processes. The CEDISS linking 
agents had to work wit.-: clear, pre-project exoectations of their" 
role and auihority vis-a-vis the local sites. In no site did a 
new role for the linking agent emerge. 

Widespread perception of the problem as a problem . This area 
included activities sucn as neecs assessment giving legitimacy 
to the definition of a problem; consensus among project parti- 
cipants and key local administrators; and a feeling that the 
problem identified required action. In CEDISS, evidence from 
the sites indicates that at least those involved with the project, 
and frequently a majority of the community (parents and business 
leaders) perceived the problem to be serious enough to warrant 
action. On the other hand, many non-CEDISS teachers and adminis- 
trators did not perceive the problems identified in CEDISS as being 
as serious as other educational oroblems. This led, as had been 
mentioned, to focused, small-scale implementation. The CEL^ISS- 
identified problems were more frequently "chronic, lou level*' 
problems (i.e., there, but capable of being lived with). CEDISS 
'itself provided the "sense of urgency" that was needed to attack 
the problems identified. 

Reasons for site involvement . Reasons for site involvement relate 
to (c) above: many of the sites had one or a few career education 
problems that had existed in the district for at least a few years 
prior to the project. Thus, problems preceding CEDISS were solved 
with CEDISS money — CEDISS acted as a catalyst, ^any sites used 
CEDISS money to attack a problem that eventually would have been 
attacked anyway. As the site coordinator at Villeneuve put it, 
"CEDISS just out us ahead two or three years; we eventually would 
have implemented the AEL product anyway." Although, in most sites 
genuine problems in career education did exist, sites were not 
nominated for the CEDISS project on thf; basis of an identified 
problem. CEDISS was "internalized" at all sites as a product 
selection and utilization project, not a process-innovation/ 
renewal project. Reasons for involvement hinged around the funds 
made available to buy career education products. Thus, reasons 
for involvement led to particular patterns of start-up and 
impl e.^f=^ntati on . 



e. The characte>-1 sties of the Innov ation. Such characteristics ir^cljced 
the aegree to v.mcn tne innovation tnreater.ed sxistirig practices; 
the context matter; the cor.olexity of the innovation; and how clearly 
the innovation was defined in peoole's minds. In the CEDISS sites 
implementing a procuct at tne elementary level--for example Per.tcn 
and Treeline — a number of issues relating to relat^jnshio of the 
product to existing curriculum were crucial because career educa- 
tion at the elementary level is usually infused into the existina 
curriculum, not added on. Thus, teachers who felt that career 
education was supnlanting basic skills instruction tended to im- 
plement less wholeheartedly. Those wno viewed it as an orienta- 
tion, not threatening basic skills time, tended to be more favoribly 
disposed. At the secondary level, career education in CEDISS 
tended to be in a separate clas3--as in Bayfield and Villeneuve-- 
and was only threatening to the extent that it "invaded academic 
department turf" in terms of distribution of class time. Career 
education in general seems tc carry intimations of blue-collar, 
vocational activities for many administrators and teachers, and 
CEDISS local leadership had to contend with this stereotyoe con- 
cept in a few sites. In one site, Villeneuve, the comolexitv of 
the product prevented it from being fully implemented for most 
of the first year of implementation. The teachers took that long 
to learn _how to use the whole product in an integrated fashion. 
In all sites, if the innovation was clearly defined in people's 
minds there was generally straightforward implementation. 

Sufficient time . Sufficient time included the timing of external 
assistance to local sites implementing an innovation; sufficient 
time for planning, training, materials preparation, and other 
pre-implementation activities; and sufficient time for teachers 
to learn to use a new product in the classroom. In all case 
study sites in CEDISS, the timing of the state's assistance to 
local sites was considered to be a serious problem. The state- 
level project managers tried to do three things: (1) develoo 
a pool of product resources; (2) train site people in problem 
solving, and (3) try to get sites to go through a problem solving 
process — simultaneously. Unfortunately, this'was not a comoletelv 
successful process. The sites were expected, for example, to choose 
a product based on the prob'iem defined, but were not provided the 
product descriptions necessary to choose that product. Thus, it 
was not surprising that almost all sites simply chose products that 
the linking agent or some other key local figure happened to know 
about and like. The state was late in providing assistance at 
almost every key decision point in the project. Consequently, many 
sites did not use the state as a source of external assistance. 
While most sites had adequate tine for pre-imolementaticn activities, 
they did not have tools. 
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perscn or" ^^i^":?^ Tin r i . : ^"'^^'i::':" ^>:'!r) : 
on an innovative Drcject; lin^'inn L'^ wit^n -C'. -.'^ir- 

ment and pGrsonal cc'-^r i tr{jn t t.n-j ::^o:^':t; rr.jo-:*. "i:';" * 
ship v/iih adecuQue tire and nGrr-iCnal cl-::*:! : iror. t; o.^.-: a,:,"^':: ' * ' *. 
of funds arid r.aterials n^rc^?s 3."^ ry L-acri o^' f^-- ; v _ t. . 

The CEDISS chance agent-- :he "l^nkirin ar:^^ , in roit 

only involved vnth ClDII'^ "c- a s-^all ::cr-.ic:n or hr: f.-- . 

This led to a linitec cc;- i-^i t.-T^ent , at boat, and 'ji'.i^r.v ' ^ * " 
contact vn'th sites d'^^-'ir.':: the c:?'jrsL.- c-' *:^o rro;!^--,:t. .■ l a- 

also, the linking aaan::5 na:: no t^-ainina or akil'' ^n an 'i'-'j- a- . 
was crucial to the ear'y ac.i-as j't ahe ;:.ra:a:t> :'rrr th'. ; :a:;:'.. 
point of viev;. This v/aa :n ^, nf 1 ae':c i nr or a^oai-^yira u i.-aa^ a : . a 
probl eai-scl vi ng e.rpraarn lo ccnfo^'n to an extaa^'ial r-oda* 1 ^' a a: ;a 
case tne state'b ^u^^a- 1 . i^ikevnse, local projoct l^^::i-a»'a la a^] 
sites had other, often vary caTancino, rez ao'vs oi 1 i a>as \;rr cr- . 
vented ther f^o:a foca-ainc rucn ene^^'^y on Cc^TISS. '!'his '^av.' navt:- 
contributed to ^.wr,ri"]Zina the imuact of CZDISS on ;ccj' :.'^aa::^a: 

h* Conti naencies . Contingencies inaluaed administrative ta:*aa\ar: 
other ongoina inr.avations ; Cecl~.ning atu'.lent enrollrrant; ^'^nd'v: 
problems; and persona^ feuas ar.cng district staff. Ali tne 
above factors affected the course of CEDISS in at least ana aite. 
In Villeneuve, pending adaiini strati ve turnover led a Key '^^oject 
participant to behave very cautiously, in o^^der to be su^^e r-.ct 
to put his position in jeooardy; in Bayfield a new suoa r^^' n tenaen t 
helped breathe life into career education activities: in Treelin-a 
other curriculum innovation projects ongoing dre*w energy av. :^.y ^"rc 
CEDIFS; and, in Ba:/fielc again, a aiillage vote that fa: lea da^^Cira- 
enthusiasm for CSDISS for awhile and caused the less of an early 
key participant in the project. 
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2. Hov7 iTiav noccU conditiops be acted upon so as to inprove the 
prcbler^-so ; y-j HQ process ? ' 



!n order to make some recommendations in this area, an a priori 
assumption must be made that tne local problem-solving process needs im- 
provement. Othenvise, the prior quesiion to (2) above would be: Is the 
existing problem-solving process inadecuate, and, if so, in what wav? 
The evicer.ce frcm CEDISS is that even asking that prior question aids 
the external change agent in his or her intervention, because it implies 
acknowledgment tnat the new process is not filling a vacuum; rather ic is 
attempting to modify a set of existing practices. 

Thus, the first point to be made in answering (2) above is: the 
change agent, to improve the local problem-solving process, must come to 
understand that process, and its history. Also, the evidence from the 
case studies in CEDISS indicates tnat external pressure can be used to 
m odify IochI orcbi en-sol vino processes cr.1v to tne decree mat moaifica- 
tions fa il^witr. in sz-.e accEotapie range of dislocation ^ Local school 
systi'.ms allow for some degree of aisruption, especially when additional 
resources are made available due to that disruption. But the "range'* is 
t'airly narrow. . 

Under what conditions can fundamental changes in problem-solving 
processes be brought about in a local setting? This question remains 
unanswered based on evidence from the Michigan CEDISS project. Particu- 
larly in moderate and small size school systems, a small number of indivi- 
duals generally make the majority of major decisions. It is simply not 
clear how they could be asked or forced to share a substantial amount of 
thei r decision-making authority. In fact, evidence from Penton and Tree- 
line indicates that teachers, for example, don't feel a need to become 
involved in certain types of decisions. Even when a new problem-solving 
process is mandatory for participation in an innovative project, as was 
the case for CEDISS, the tendency appears to be passage through the process 
in a minimal, pro-forma manner, and return to pre-project patterns of 
decision-making as soon as project requirements are fulfilled. 

Nonetheless, evidence from the CEDISS sites suggests a number of 
concrete ways to influence, at least incrementally, local problem-solving 
practices. The needs assess ment proved to be a very useful tool to 
mobilize people around tne problem in the Copper Lode site. The needs 
assessment process and findings lent legitimacy to the problem definition 
arrived at and enhanced consensus among community members and school 
officials. As one CEDISS participant noted, the needs assessment keeps 
key administrators from openly resisting a project, even if they don't 
suppor^t it. 

CEDISS der..:nstrated that another way to act on local conditions so as 
to impr-ove prob i cm-sol vi na processes is to provide local systems with 
hu-nor)_a_rid_nn_t_o>^': ?J_^rj?so!;j"CL;^ For example, to get teachers involved in 
idcr^ti tying probieins and rinding solutions to those problems it is often 
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necessary to "buy" them release time--e:< ternal funds are useful here. A 
resource person with skills in problem solving, some substantive area, 
group process, etc., wno is available to work with a local grouo on a 
regular and consistent basis, can influence that group. Sometimes, bringing 
a product developer or some other person with a fresh idea in can have a 
catalytic effect. This was the case in Villeneuve. ^-laking funds available 
to inplement an innovation--a straightforward intervention— can bring a 
group of people together who normally don't interact as a group. By 
e xpanding the pool of "solutions" available to solve a problem, an external 
or local cnange aceni can ma.<e i i necessary for local peoole at least 
nominally, to go througn a problem-solving process to select the most apt 
solution. ^ 

Experience from CEDISS suggests that it is possible to modi fy 
receoti vi tv to an innovation or an innovative oroject. There was seme 
traae-off in CEDISS between project effects on problem-solving processes 
and ease of installation of the innovative product. That is, the less 
disruptive the CEDISS crojeci was within the local setting, the less the 
likelihood of lonn-term effects on prool em-scl ving practices. In Treeline, 
for example, project directors decided that the innovation was so small that 
it v/asn't worth peopie^s time to go through a formal, group problem-solving 
process. In most of the sites of the CEDISS project, teachers felt free, 
also, to adapt the innovative product selected for classroom use, and this 
enhanced receptivity to the product. Teachers felt that they nad some 
autonomy within the project. 

The relation between project effects and ease of installation suggests 
another way of modifying receotivity to a new process or project. That is, 
to demonstrate to local participants that the benefits of goinc th rough a 
nev/ or modified orobl em-sol vi no process are wortn the costs . Some k i r d of 
incentives must be offerea that are of value to local participants. Decision- 
makers asked to share authority must feel that there is something they can 
gain by sharing decision-making power. This approach to acting on local 
conditions was generally absent in CEDISS. 

The attitude of the change agent toward local conditions is, as was 
mentioned, central to modifying local practices. Two points emerged clearly 
in CEDISS: (1) the change agent must relate local sites to his or her 
model of problem, sol/ing at wnatever ooint they are at ; and [2) tne change 
agent shouldn't exc-ect lOcal sites to drive them se lves through a new prop i em- 
sol vi ng process , using sore calculus of internal mctivation . 

With respect to the first point, CEDISS started out with a flexible 
model, containing a number of potential paths for local sites to follow. It 
seemed that the model would interact with local practices, and both would 
adapt themselves. Yet, in applying the model, the state made no attempt to 



-On the other hand, in at least one CEDISS site, Bayfield, certain CEDISS 
participants felt overwnelned by the variety of alternative products, and 
simply couldn't face going through them all systematically. 



bring itself to where the sites were: the sites were expected to do all 
the moving. This proved to be unrealistic, and led to mini~al process 
effects from the project. All sites, without exception, followed their 
existing problem-solving practices, clothing them in the language of the 
state model to insure compliance with project regulations. 

With respect to the second point, evidence from the CEDISS sites 
indicates that local sires cannot be expected to be inherently motivated 
to go through a new, formal problem-solving process just because thev are 
participating in an innovative oroject. Local practices are inevitably 
deeply engrained, and are pan of a historical pattern. Alot of effort 
is needed to jar them loose. 
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3 . Are there any feat'jres cf the nature of the problem that should 
guioe tne nanaaer^eni of ine prcpl en-sol v1 nc crocess ? 

It is difficult to answer this Question in a straightforward mannei- 
based on evidence from CEDIS3, because the CEDISS project as an intervention 
created a need for sites to have a problem. In every school district there 
are a multitude of problems perceived to be so by oarticular individuals and 
groups. Even those fev/ problems universally acknowledged to exist — for 
example, gradually eroding achievement scores for children in som;e grades — 
are interpreted differently vith respect to cause and seriousness by various 
groups . 

Thus, as a first point, it can be concluded that why a problem is 
identified and v/ho identifies that problem should be considered in tne 
management of zr\e proci em-sol ving process. Ov/nership of the problem is 
crucial. In the case of CEDISS, a problem was identified to satisfy require- 
ments of a project in order to acouire som.e external resources. While every-- 
one involved with CEDISS at a site usually felt that a genuine problem 
exisiec, only a few people at each site, at most, felt that a serious 
problem existed. As the site coordinator at Villeneuve put it, lack of 
career planning and decision-making skills am.ong high school students is 
seen as a "chronic, low-level problem." Such a problem doesn't have a large, 
active constituency fighting for its solution. 

Almost all the CEDISS sites defined thei probl em as a goal statement. 
That is, they viewed the "problem" as justifying the use of the resources 
they would be granted througn ine project . Implications for managem.enL of 
the problem-solving process for CEDISS were (1) to steer the course of 
problem identification to sho\u that there was a need and use for the 
proposed funds; and (2) to define a problem in terms of the project (i.e., 
ascertain the project's goals). That is why one site, Treeline, defined 
its problem in terms extremely similar to the stated goals of the state- 
wide project. 

VJho defir:?s the p)"Oblem relates closely to who feels committed to solving 
the problem , "'ost teachers wno eventually pariicipaied in CEDISS projeci a^^a^ 
not take part in early problem-solving activities. The CEDISS project to them 
was using a new product or products in their classroom. Some knew of the 
problem defin^^d in their sites, some didn't. Few changed their teaching 
to "solve" the problem. Those few teachers who v/ere involved in problem- 
solving processes, such as Bill Armone in Villeneuve, clearly felt a greater 
sense of ownership of the problem, and were more inclined to change basic 
teaching practices with reference to the problem. 

The number of peco le affected by a proble m should influence the manage- 
ment of the prcol em-soTvi ng process. Tms prop'osition v;as at work implicitly 
or explicity in all the CEDISS sites. Local manageri of CEDISS only involved 
people who had to be involved at various points in the problem-solving process. 
There v;as what could be called an economy of participation. In Bayfield, 
Treeline and other sites, for example, only those district administrators who 
clearly had to be involved in erirly decisions wei^e brounht in to the process. 



EKLC 



) There v;as what could be called an 2Z2I1—1LP^ cartici ostion. In Savfield, 

Treeline, and other sizes, for exar~pie, cnly~ncEe aisirici adrr.ini strators 
who clearly had to be involved in early decisions were brcucht in to the 
process. In Penton and Treeline, a conscious decision was made not to 
involve teachers in elements of the problem-solving process that didn't 
specifically concern their needs. The econony of participation rule 
translated, in scrne CEDIS3 sites into: the orobl em-sol ving team should be 
relevant to its composition to the task at hand; it is not effective or 
efficient to involve people in issues that don't interest them. In a number 
of CEDISS sites parents who were members of the site team did not partici- 
pate in product review sessions after the first session. Product review did 
not interest them. 

Economy of participation conflicts in its purposes with ownership of, 
and therefore commitment to, the problem. In Treeline, for examole, and to 
an extent in Penton, teachers not involved in early decision-making said 
that there was no need for them to be involved. But those same teachers 
v/ere less comimitted to CEDISS as a project. There is a need, then, for 
managers of the prcbl em-sol vine process to balance oarticioation and 
consensus seeking with economy and f orw a rd procress . 

Whether a 'problem is novel or has a history in a particular setting 
also influences the management of tne problem-solving process. For example, 
there is evidence from the CEDISS sites that a novel problem may require 
consensus-building activities to enhance likelihood of adequate local commit- 
^ ment to its solution. In some cases novel problems require more external 

assistance in their solution. A manager trying to solve a problem that has 
been. in existence in a local setting for some time should pay attention to 
the history of attempts to solve that problem. Managers of the Treeline 
CEDISS project were aware of long-time resistance to career education by the 
elementary director. They thus managed to work around this person in imple- 
menting a CEDISS product in the elementary schools. 

The size and complexity of a problem should, and usually do, guide 
management of the prob lem-sol ving process. For example, the problems identi- 
fied by the CEDISS sites were generally small, in terms of number of people 
effected, compared to others in the districts. Thus, relatively few actors 
became involved in their solution. It wasn't usually necessary to form 
committees and go through fcrm^al district lines of authority in order to 
implement one or cwo classes of career education. In Bayfield and Penton, 
for example, the principals only, rather than a full committee, were needed 
to authorize imipl ementa ti on . In Treeline the extensive and complex district 
machinery for implementing inno^^ation was avoided: the problem just wasn't 
large enough. 

More comple x problems tend to affect either more people, or affect oecple 
in more ways, both; they are nardei^ to manage than simple problems. Managers 
of more compleA problems nave to be more sensitive to the political ramifica- 
tions of changing local practices to solve such problems. Disruotion and 
dislocation of ether activities is usually a significant effect of trying to 




solve cciTiplex problen^s. A number of the local nanagers of CE:DISS projects 
reduced the corr.plexity their problem, by defining^it so that it affected 
fewer people in clearly delimited ways, this tended. to make CEDISS an 
easier project to manage locally. 
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4- What kinds of external tactics or resources are nost effective 
at various pnases in tne crob lem-so ivlna process ? 

High/Scope's final Site Status Survey, adrriini stered just before the end 
of the sites' participation in CEDISS, revealed that sites felt they neeced 
the most outside help in three particular phases of the probl em-sol vina 
process: searching for a product, selecting among the products found/and 
evaluating the products impl emented. They felt much less need for help in 
three other steps: identifying goals, defining specific needs, and imple- 
menting the product. Figure 1 displays those responses graphically. 

Survey respondents said that if they were beginning CEDISS again, the 
resources they'd want more of would be training (both 'on site and^at work- 
shops), products to choose from and time to complete the project. Half of 
all respondents said that they would need no more funds than they were granted, 
but another 30% said they'd need ''a lot more." (See Figure 2.) 

We observed during the course of CEDISS that even when sites needed 
considerable assistance (by our personal standards), many were not agaressive 
in requesting it (from MDE, High/Scope, the ISD, or local sources). Perhaps 
this reflects low project motivation in the sites observed, or perhaps it 
means that they had low expectations of being satisfied. In either case, 
we believe that the projects at those sites would have been stimulated by 
supportive visits from the staff connected with CEDISS at higher levels, 
from the ISD on up. It appears that such visits should be made as early 
as possible in the life of the project, and often. The dilemma, of course, 
is that all the would-be visitors are busy getting organized themselves 
during this start-up period. Yet, early and encouraging contact with higher 
staff seems critical to the vitality of local projects undertaken at long 
distances from the sponsoring agency. 

Workshops served both to convey valuable infonnation and to give 
participants a sense of " special ness Thus workshops represent an impor- 
tant mechanism of project management. (Figure 3 shows how CEDISS partici- 
pants rated Workshops 1-3, among other resources.) But school practitioners 
can be devastatingly critical of teaching that doesn't meet their standards, 
so it is especially important for the content of the workshops to be seen 
as relevant and the presentation effective. In this connection, a strong 
effort should be made to relate each workshop to the immediate practical 
needs of the various participants. This is easier to accomplish in small 
regional gatherings than in large centralized ones. Note in Figure 3 that 
Workshop 3, which was designed to provide for special consultation with 
each local group, received the highest ratings of all three workshops. 

Periodic follow-up on early contacts is also urged. This can be done 
effectively by phone in most cases, and the intervals can be longer in the 
later stages o-^ the project. Such coniact provides sires with assurances 
of continuing concern for their success and also serves as an invitation for 
site personnel to request assistance that they might not otherwise ask for. 
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Question 1; 



Figure 1 

SUPPOSE YOUR SITE WERE JUST NOW BEGINNING THE 
CEDISS PROBLEM-SOLVING PROCESS. HOW MUCH OUT- 
SIDE HELP (FROM MDE OR ELSEWHERE) WOULD YOU 
WISH FOR AT EACH STEP? 



CEDISS Prohlem- 
Solvincr Sceo 



Identifying Goals 
(N=8 8) 



None 

A l-ittla 

A fai-v arr.oun- 

A lot 



*> rtesponazng a.s Iv.aicatsa. 
10 20 30 40 50 60 



']14- 



11 



0 0 



0 .i 



Defining Specific 
Needs (N=8 6) . 



None 

A little 

A fair amount 

A lot 



']12% 



0 cv 



29'. 



J 50% 



Searching for a 
Product/Solution 
(N=87) 



None 

A little 

A fair amount 

A lot 



8% 



46'. 



38% 



Selecting Among 
the Products/ 
Solutions Found 
(N=88) 



None 

A little 

A fair amcunt 

A lot 



15% 



1 34% 
37% 



Implementing the 
Products/Solutions 
Selected (N=87) 



Evaluating the 
Product/Solution 
Implemented (N=8 7) 



None 


23% 


A little 


* 


A. fair arr.ount 






A lot 


11% 




None 


S% 




A little 


22% 





-> A ja'.r arioun 
A lot 
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7% 
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Figure 2 

Question 2: IF YOUR SITE b"~E?.E BEGINNING THE PROBLEM- 
SOLVING PROCESS AGAIN, WOL-LD YOU WANT MORE 
OR LESS OF THE FOLLOWING RESOURCES THAN 
-YOU ACTUALLY HAD? 



P.esr>or.dir.Q as Indicated 
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A lot less 








Training at MDE ' s 


A little less 








CEDISS Workshops 


The same 








(N=84) 
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Training on Site 
(N=84) 



Consultation With 
MDE Staff (N=87) 



A lot less 

A little less 


0% 
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A lot more 
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A lot less 
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~]2% 
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Consultation Kith 
Others Hired by 
MDE (N=85) 
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A lot less 
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Consultation With 
ISD Staff (N^72) 


A little less 
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29% 
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A lot less 
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Consultation With 
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Staff (N=85) 
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Figure 2 
(continued) 
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Figure 3 



Question 3 



HOW USEFUL WAS EACH OF THE FOLLOWING 
TO YOUR SITE'S PROJECT? 



S Eesponding as Indicated 
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30 



40 



50 
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Workshop 1 (Goal Setting 
and Needs Assessment) 
(N=71) 



Not all 
A l-ittle 
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30\ 



Workshop 2 (Identifi- 
cation , Review and 
Selection of Products) 
(N=80) 



Not at all 
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Fairlij 
Vevy 



13% 



34% 
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Workshop 3 (Implemen- 
tation and Evaluation) 
(N=82) 



Not at all 
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Fai-ply 
Very 
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CEDISS Product 
Fact Sheets (N=84) 
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MDE Staff Consultants 
(N=79) 
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5. What types of linking acent roles shc /j1d be defined to irrTDrove the 
exchange between tng g-j sserr^i naii agency ann zne oozsntial scnoGi 
cl ient? 



Process and Product Aspects of the Linking .^gent's Role 

The CEDISS sites that followed MDE's probl en-sol vi ng model en route 
to implerrienti ng a career education product we>^e actually carrying out three 
innovations: (1) the use cf a nev/ deci sion-n^aking process to^ (2) select a 
new product which was to be (3) in^pl emented by a new organizational process. 
Different kinds of linking behavior were called for by these three separate 
innovati ons . 

Many CEPD coordinators felt somewhat rernote f^or^ local districts* 
.decision-making nechanisnis, and hence were shy about involving ther^selves 
prominently in the school's deliberations under CEDISS. Fron^'wnat we know 
of the way ISDs were regarded by the local schools, we judge the CEPD coordina- 
tors ' ^ reti cence to have been politically prudent. In inos.t cases the CEPD 
coordinator had neither the fonnal authority nor the informal social recogni- 
tion that would have been required for close involvement in the decision-^ 
making process. In general, site teams proceeded on their own to establish 
the nature of the local problem, and depended on the CEPD coordinator, if 
at all,^mainly as a product librarian. Many CEPD coordinators felt comfortab'ie 
with this restricted function, since their usual role vis-a-vis schools is 
to deliver resources, not to manage local activities. Furthermore, the 
coordinators were better acquainted with MDE's conception of eligible pro- 
ducts than they were with MDE's conception of the process by which the pro- 
ducts were to be chosen. 

Once a product had been selected, the CEPD coordinator was again in 
the unaccustomed realm of process--this time the process of installing the 
product in the schools. And again the coordinator was not equipped by 
precedent to involve himself in this highly political asnect of school 
affai rs . 

If wo assume that these thrpe phases of innovation (let's call them 
"problem definition," ''solution selection," and "implementation") are 
characteristic of projects like CEDISS, then MDE's task is to identify (a) 
the linking actions conducive to each phase, (b) the personnel who can most 
effectively carry out the actions, and (c) the kinds of support (training, 
resources, authority) that these personnel will need to fulfill their linking 
roles. Figure ^ illustrates tnis point of vi'ew with examples- 

Our experience with CED'SS suggests that linking resoonsi bi 1 i ties shc.ld 
perhaps be transferred from off ' :e to office as an innovation progresses. 
For example, local school district staff might take resnonsibi 1 iiy for se:.^r:i 
things tfirouch tne problem cefinition phase, at which point the CEPD ccorc--:.^-- 
tor could pick up on the task of product selection, whereafter implementaticn 
would be managed by teachers or administrators from the local schools. This 
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An Illustrative Framework for Considering Linkage Requirements 



Generating Interest/ Concern 
Focusing Discussion 
Establishing Consensus 
Providing Information 
Providing Training 
Obtaining Authorization 
Resolv'fig Technical ProbleiRs 



Resolving Social Problems |w 



Etc. 



POTENTIAL SUPPORT FOR LRJKiHG 
PERSOWL (Relate to Each Cell) 



Training in Croup Dynamics 
Training in Project flaiiafiaient 
Familiarization with Relevant 
Products 

Access tn Materials 
Access ifi Funds 
Access to Su|jp(i'i Staff 
Fii^cal /iUioi ily 
I'anageri'tl Authority 
Etc. 




u 

0 



whole process would be overseen by soneone central to the project--perhans 
special advocates assigned on a regional basis by MDE. The critical poini 
is that each s-c-parate phase of innovation requires its own brand of facili- 
tation, calling -'or different attributes on the part of the linker. 



Captation of Linkage Arrangements to Site Conditions 



Ideally, linkage arrangements would be tailored to suit the character 
of each site. If the reauisite qualiiies of a linking agent we>"e detcnrined 
to be, say, local creoibility, Dolitical acuity, and knowledce cf the sub- 
stance 0^ the innovation conteT.pl ated , then the role qf linking aaent might 
go to tlie indiviaual who best fit this description, whether the CEPD 
coordinator, superintendent of schools, principal, or teacher. We found 
in CEDISS tr.az certain oeople energed as natural facilitators and that 
.these were r.ct necessarily the same kinds of people fron site lo site. 
There is no uniform set of categories from which linking agents can be 
confidently selected in the future. However, it might be possible to develop 
a systematic nomination crocedure whereby school staff in each locality would 
identity individuals from their circle who possessed the characteristics 
critical to effective linkage. This v/ould probably complicate the state's 
job of project management, but it would also avert some of the problems that 
occur when responsibilities are assigned by fiat to those who lack requisite 
qual i ties. 



Provision of Incentives for Active Linkage 

MDE, beyond providing the resources a linking agent needs to carry out 
his or her role, should also provide incentives for active fulfillment of 
the role. If a linking agent could count on the rewards of local gratitude, 
affable social contact, enhanced political status, and career advancement, 
MDE could count on more diligent performance on the linker's part. Under 
CEDISS, these rewards were sometimes missing. Vocati onal -techni cal coordina- 
tors, for example, tend to identify so thoroughly with vocational matters 
that career education responsibilities are regarded as a burden to be 
minimized. Thus they cannot be expected to snow great initiative under a 
program like CEDISS unless their own interests are somehow made organic to 
the program. 
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6. What types of individuals should be selected for linkinq roles? 



Ideals Vary with Situations 

It seems clear that different types of linking agents are called for in 
different school settings, but our experience is not complete enough to 
allow us to be definitive about these differences. At best, we can describe 
what we perceive to be the salient characteristics of successful linking 
agents in general , acknowledging that there are many linking agents who deDart 
from this general description and are nonetheless very effective in their 
local settings. 



Political Credibility and Professional Incentive 

The linking agent is a buffer as v/ell as a nexus. He or she serves 
not just to channel outside resources to local projects but also to handle 
the red tape that inevitably accompanies an externally funded project. This 
means that the linking agent should have some prior political credibility 
with the local staff. Further, he or she should be seen as someone who has 
an intrinsic interest in the success of the project rather than as a bureau- 
crat with just another burden to bear. Thus the linking agent should be 
someone who stands to share in the gains made by the project. In CEDISS, we 
found generally that CEPD coordinators who were not responsibl e for voca- 
tional education had a greater interest in developing career education 
programs 5 since their professional stature depended on the furtherance of 
career education. On the other hand, career education seemed to be a thorn 
in the side of CEPD coordinators v/hose main duties concerned vocational 
education. Local staff can be expected to be reticent to call on the help 
of a linking agent whose heart isn.*t in the work that they consider important. 



Personal Acquaintance and Prior Authority 

Personal acquaintance seemed to be a vital factor in relationships be- 
tween local staff and CEPD coordinators under CEDISS. In cases v/here a 
familiar prior relationship existed, reliance on the linking agent was notably 
stronger. Thus a linking agent who has earned tfie trust of local staff 
stands a better chance of working effectively v/ith them in cooperative 
ventures. If the linking agent already has a position in the line of command 
in local school affairs, that's a plus, since a precedent then exists for 
assumption of some degree of authority. Otherwise, it can be difficult to 
establish this authority vjithin the time span of a project like CEDISS. 
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Assur^otion of a Faci 1 i tati ve Rather than Directive Posture 

Many CEPD coordinators v/ho v/ere, in our eyes, very effective, acted 
as facilitators rather than initiators. That is, they saw their ourpose 
as being to helo local staff carry out their own decisions rather than 
urging the staff toward any particular decision. Linking agents v;ho take 
this "faci 1 i tati ve" point of view are lik'^ly to have greater success in nosx 
cases than those who are inclined to inpose their own ir. ; tiatives. In this 
sense, many of the CEPD coordinators who v;ere most effective under CEDISS 
were agents of stability rather than change. 



7. What types of organi ze tional settings and support mechanisr^s shoul d 
be providecl tcr linkers"? 



Our observations of linking agents in CEDISS were for the most part 
restricted to one type of linking agent (the CEPD coordinator) in a 
particular organizational setting (the intennediate school district). We 
can only speculate on what would have happened to other types of linking 
agents in other organizational settings. 

The linking role described by CEDISS is basically compatible with the 
overall "mission*^ of the intermediate school district^ in Michigan. Inter- 
mediate districts are service agencies, designed in part to provide for 
local districts services that they would be unable to afford for themselves. 
This makes them in many ways an ideal setting for linking agents. There 
are some disadvantages associated with the ISO setting, however. In some 
areas of the state, for example, local school personnel that we spoke with 
view the intermediate district as remote and unresponsive, taking more from 
the community in tax dollars than it returns in educational services. In 
these areas it was difficult for CEDISS linking agents to provide the 
relationships that their role demanded. 

The ISD is also a less than ideal setting from which to intervene in 
the decision-making and problem-solving processes of local schools. The 
ISD is a service agency with little direct authority over constituent 
schools. The ISD prospers by making itself useful to local school adminis- 
trators. As Bayfield and Penton case studies illustrate, there is con- 
siderable incentive for helping schools identify products that meet 
identified needs. There is much less incentive, however, and indeed 
considerable risk, for ISD personnel to intervene in schools* problem- 
solving and decision-making processes. 

The ISD setting for CEDISS linkers seemed to work best when the local 
site was in a relatively small school district. Larger school districts in 
Michigan, such as Rolling Rock and Treeline, duplicate many of the functions 
and services of the intermediate district. School personnel consequently 
have little contact with the ISD. In Rolling Rock, for example, the school 
district had its own Office of Career Education staffed by specialists who 
assisted local schools in designing and fielding career education programs. 
In larger school districts such as these, the district itself may be the 
best setting for linking agents. 

Several alternative settings for CEDISS linking aaents were observed 
while preparing the CEDISS case studies. These were the Regional Educational 
Media Centers (REMCs), the Supplemental Centers, and the Professional 
Development Centers (PDCs). Although all of these centers are housed in 
particular intermediate school districts, each serves a region that spans 
several ISDs. There are 22 REMCs serving ti\2 55 intemediate school districts 
in Michigan. The REMC was designed to serve as a resource library for 
educational media, such as audiovisual products. In practice, many REMCs 
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have expanded their focus to include a much v/ider range of products and 
services. Each REMC has a resource librarian to assist local schools in 
identifying resources that meet their needs. 

The Regional Supplemental Centers (supported by Title IV C of ESEA) 
and Professional Development Centers are more recent creations than REMCs- 
Currently, there are ten Supplemental Centers and six PDCs in Michigan. 
Almost all of these centers are housed in the ISDs with REMCs and serve 
the same region as the REMC (one PDC is located in a large local school 
district). Staff from the Supplemental Centers help schools adopt and 
implement products from a pool of programs validated through either the 
Department of Health, Education and Welfare's Joint Dissemination Reviev/ 
Panel, or the Michigan Experimental and Dem.onstration Classification 
Committee. Supplemental Centers are oriented toward process, and center 
consultants work with local districts in planning, needs assessment, pro- 
duct review and training. They do not for the most part provide money to 
districts for purchase of products, but they do help schools secure avail- 
able state funding for their adoption. The mission of the PDC is to provide 
local schools vn'th assistance in identifying and securing services needed 
to imorove the professional caoabilities of teachers. These services may 
include a validated product from the Supplemental Center's pool, but may^ 
also extend to consulting services or locally initiated training activities. 

Although the REMCs, Supplemental Centers and PDCs are separate programs, 
many ISDs (such as Rolling Rock's) combine all three under one director and 
staff. The principal advantage of the centers as a base for CEDISS linking 
agents is that they are staffed by individuals trained in the RDU-style 
linkage and problem-solving processes. Further, by consolidating linkage 
programs in a few ISDs, a "critical mass" of trained linkers has emerged 
in several state locations v/ho can support and encourage each other in their 
1 inkage activities . 

A disadvantage of the centers is that by serving a large region they 
are sometimes quite remote from the schools they are supposed to serve. The 
closest REMC to Bayfield, for example, is almost three hours drive from the 
school. Aside from the geographical distances, the center staff is also 
remote bureaucrat ical ly. Bayfield's REMC, for example, is located in an 
ISD little known to Bayfield's principal and teachers. 

The issue of optimum support mechanisms for linking agents has already 
been touched upon. A linking agent needs at least three things to be 
successful: information, legitimacy, and suooort. The CEDISS expe^^ience 
suggests some support mechanism.s that help satisfy these three neecs. 

The linking agent depends on inform.ation to be effective. The most 
effective CEDISS linking aGent5--those in Bayfield and in Penton~-were 
successful becp.'ise they v/ere perceived by teachers and adm.i ni stra tors to 
be sources of information that v^as unavailable elsewhere. There seem to 
be several ways to miaximize the information available to linking agents. 
First, pools of available oroducts and consultants should be available to 
linking agents at tho s"-:^^" V:r- r^^^'joct, net ridv;^y th^^cu^h it as was 
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the case with CEDISS. Second, the linking agents should be trained in the 
CEDIS5 approach separately before the start of the project, net after. 3y 
training CEPD coordinators with site teans , CEDISS created linking agents"" 
who were perceived by site teams as having no more knov/ledge about problem- 
solving resources than they. In Bayfield, for example, the linking agent 
v;as widely respected for his knowledge of career education products, but 
not for his understanding of the CEDISS probl em~sol vi ng process. A third 
approach to increasing the information available to linking agents is to 
create a cotmuni cati ens network among linking agents in a region or across 
the state so that any one linking agent can draw upon the knowledge of his/ 
her colleagues to solve particular problems. Such a network exists now 
informally; it could be formalized and expanded. 

Legitimacy is important at both the local and intermediate district 
levels. At each, the CEDISS linking activities m.ust be perceived as a 
necessary part of the linking agent's regular duties. The CEDISS linking 
agents did not always have this legitimiacy. Those who were also Vocational- 
Technical Specialists for their ISDs were expected to concentrate on 
vocational education, not career education. Local school administrators 
at Penton and Bayfield did not see involvement in problem-solving processes 
as a legitimate activity for their CEPD coordinators. Legitimacy can be 
created in a variety of v/ays. First, it seems to be important for local 
school administrators and staff to be made familiar with the goals of the 
project and the role that CEPD coordinators/linking agents will play in it. 
Second, if the new role is different from the existing role it must be 
supported financially by the project. The CEDISS project contributed nothing 
to the salary of CEPD coordinators, but expected them to become process- 
oriented .1 inking agents in addition to vocational specialists. There was 
little time or incentive for thi^ to happen. 

Linking agents must have adec.uate support because intervening in local 
problem-solving processes is an inherently lonely task filled with frustra- 
tions. Few can succeed v/ithout support from supervisors, colleagues, and 
clients. There are several routes to support. In Rolling Rock, there 
were several linking agents housed in the same ISD because of tne Suppl em.ental 
Center and Professional Development Center. These linking agents provided 
a support group for each other. In Penton, an active career education 
advisory committee provided counsel and moral support for the linking agent. 
Several linking agents, notably those in Treeline and Penton, participated 
in a local circle of career education coordinators who could consult and 
encourage each other. 
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8. What types of training orogr^ms or orientation materials to support 



linking roles should be ceveloped? 



Conferring a Badge of Professional Expertise 

Our experience with CEDISS sites suggests that a program of training 
should be provided to all linking agents, asseinbled as a single group or 
in regional groups, and apart from the clients they will serve. This 
training v/ould help to provide a sense of professional identity, reinforce 
social contacts, and give the participants formal credentials as linking 
agents. These credentials would represent a badge of , expertise not shared 
by the linking agent's clients, thus enhancing his or her leadership role. 
When linking agents and clients are trained together, on the other hand, 
the expertise is distributed equally, diminishing the linking agent^s 
^ 1 eadership status . 



Promoti ng Professi onal Connecti ons 

One quality that made linking agents successful v;as the fact of their 
having "connections." They had the ability to locate needed resources, 
obtain higher authorization for local actions, produce critical information 
from external sources, and so forth. When linking agents are trained 
together, the social context encourages the formation of productive connections. 
They become a netv/ork of mutual resources, and membership in this network 
enhances their local linking functions. The functioning of this network 
should be reinforced by periodic conferences of linking agents, even after 
the initial goals of training have been reached. Communication and the 
sharing of resources could also be encouraged by the installation of low- 
cost telephone lines, publication of a newsletter, and institution of a 
computer-based conferencing system allovn'ng rapid conversational exchange in 
print. Systems of this latter sort are operating now all around the country* 
Several are flourishing at the University of Michigan. One particular 
advantage of such a system, is that it can be designed to allov/ automated 
information retrieval --for example, by searching out messages containing 
key v;ords of special interest. 

With this sort of support, Michigan's linking agents could coalesce 
into a self-sustaining professional society. 



Emphasis on Active Participation in Lifelike Situations - 

Content: true to life . One of the main criteria that CEDISS partici- 
pants used in judging the value of workshops was, understandably, the 

relevance of the training to their on-the-job responsibilities. When they 

liked a workshop, it was usually because it gave them ideas or skills that 

they could apply v/hen they returned to their sites. When they didn't like 

a workshop it was usually because the content was too general, or too far 
cut of phase v;itr. '.'r\Qir pr:::,r-: , to b- i; • •:'M::tPly applicable. 
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_ Method: active . In the same spirit, a training aporoach involvina the 
active practice or new skills was preferred ever an aoproach involving 'more 
passive participation in the form of listening, reading, viewing slides, etc. 



Reliance on Existing Training Models and Materials 

The National Training Laboratory in Bethel, 'Main has for many years 
offered training to personnel involved in promoting oraanizational cnange. 
Organizations such as Hun^an Resource Developnent Associates in Ann Arbor, 
the Organization DevelcDment Consortium of Lansina, and the Network, 
Andover, Mass., also provide access to valuable training resources. The 
Rand Corporation's studies of change agents and of the process of change 
certainly^ constitute relevant material, as do the case studies that High/ 
Scope performed for Project CEDISS. A simulation called "The Diffusion 
Game" (published, as we understand it, bv the Northwest Reaicnal Laboratory) 
"was mentioned favorably bv many CEDISS particioants , who took part in the 
game unde- the auspices of the" State Adoption Program. Finally, Peace'"' 
Corps and YISTA voluntee^-s and agricultural extension aaents all receive 
training that should logically be relevant to the roles^of linking agents 
in Michigan, and these programs bear examination. 

In adapting these materials, emphasis should be placed on disseminating 
their contents through active modes such as personal conversation, public 
demonstration, and role playing. Materials that are merely" presented 
between covers are liable to sit neglected, no matter how great their ooten- 
tial value. A number of CEPD coordinators admitted that they had never even 
looked at the manuals prepared for their use by MDE. However, if they 
were first introduced to the substance of these materials by active means, 
they would be much more likely to pull them off the shelf in the future to 
refer back to them as familiar resources. 
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1.0 Introduction 



1.1 This report summarizes the results of data gathered from 61 Career 
Education Planning District (CEPD) coordinators, Michigan Department of 
Education (MDE) personnel, and other individuals associated with the 
Career Education Dissemination Project (CEDISS) . The data were obtained 
by mail questionnaire and telephone follow-up during the May-September 
1979 time period. The respondents to be contacted were provided to the 
contractor by CEDISS staff. The results are intended to provide infor- 
mation for use in the further development of training efforts to support 
Career Education activities in the state of Michigan. Three types of 
data were collected: job perceptions, training need suggestions, and 
communication network data. The study was designed to provide some com- 
parability with a preliminary project conducted for CEDISS three years 
ago. The results should assist persons responsible for Career Education 
programs to develop training and other forms of support necessary for 
effective program develox>raent . 

1.2 The job perception data were based on lists prepared by CEPD coordi- 
nators, meeting in 197 6 with the research staff. They were asked to name 
the major activities in their role as CEPD coordinators, and then to 
identify the characteristics of the work they perform in carrying out 
those activities, i.e., ^'what they must be^ or do_ to perform the activities." 

The lists were condensed into an instrument (see Appendix A) which con- 
tained the activities they named. An item appeared on the instrument 
only if it was listed by at least two of the discussion groups. The 
items were simple declarative concepts of the form: "provide leadership," 
"public relations," or "fight for money." 

The 1979 instrument mailed to 74 respondents contained all but one item 
from the earlier list (the "hide out" item was omitted because it was 
not relevant to the 1979 respondents) . Each respondent was asked to rate 
the importance of each activity. They also rated their own skills at 
performing each activity. A rating scale varying from 0 to 10 was used, 
where 0 indicated complete unimportance or no skill, and 10 was complete 
importance or very high skill level. 

1.3 The training needs suggestions were based on responses to four open- 
ended questions. Respondents were informed of four topics under discus- 
sion in the MDE as possible sources of training and assistance. They 
were: (1) development of a Community Resource Guide, (2) needs assess- 
ment, (3) area-wide intern programs for youth, and (4) area-wide job 
placement/ job bank. About one-fourth of a page was provided to comment 
on each possibility. 



1 

For the complete instrument, see Appendix A. 

2 

Farace, Richard V. and James A. Taylor, "CEPD Coordinator Training 
Analysis: Summary Report," submitted to MDE, October 1976. 
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1.4 The communication network data were generated by a network analysis 
instrument which asked respondents to assess their communication links 
with one another. They indicated how frequently (in the past six months) 
they talked with others on the list about three different topics: (1) 
their job, (2) Career Education, and (3) CEDISS. The instrument included 
the names of all CEPD coordinators, four Michigan Department of Education 
staff members, and other individuals. The network instrument is provided 
in Appendix A (see Part III). Of the 74 instruments initially mailed out, 
61 were returned and usable (84%) . The 13 not returned included nine 

who refused and four who had resigned, gone on leave, etc. 

1.5 Job perception, training suggestions and communication network data 
were gathered to: 

1. Identify major discrepancies between perceived skill and 
importance levels for 12 job characteristics, and compare 
with earlier results, 

2. Summarize training needs suggestions in four areas relevant 
to Career Education in 1979-80 and forward, and 

3. Examine the potential for facilitating communication among 
the respondents and compare v/ith earlier resutls* 

2, 0 Results of Job Perception Analysis 

2.1 Table 1 gives the rank ordering by importance of the 12 activities. 
The first column of figures gives the average (arithmetic mean) of the 
responses from the 61 persons who completed the instrument. The higher 
the value, the more important the activity was considered to be. The 
activities are ranked from most important to least important, top to 
bottom . 



Table 1. Ranking of Activities: Importance 





Activity 


Mean 


S .D. 


1. 


Provide Leadership 


8. 97 


1.87 


2. 


Developing Plans 


8.55 


1.92 


3 . 


Information Dissemination 


8.36 


1.78 


4. 


Identify Needs 


8.36 


1.78 


5. 


Organize Activities 


8. 19 


1.92 


6. 


Interpret Regulations 


7.97 


2.18 


7 . 


Public Relations 


7 .89 


1 .92 


8. 


Fight for Money 


7.84 


2.()3 


9. 


Write Proposals 


7.70 


2.05 


10. 


Conducting Meetings 


7.60 


2.09 


11. 


Fill Out Forms 


7.48 


2.54 


12. 


Attend Meetings 


6. 98 


2.47 
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The second column contains the standard deviations of the results around 
each mean. The larger the value, the greater the difference of opinion 
the respondents had about the activity. Conversely, a small standard 
deviation indicates high agreement about a given mean value. 

The results indicate that CEPD coordinators view certain "subjective" 
activities as more important than other more "objective" tasks. In this 
sense, "providing leadership" and "developing plans" are much more elusive 
skills — particularly in terms of training — than, for example, writing 
proposals, because the former involves more complex interpersonal communi- 
cation abilities. 



While providing leadership and developing plans are considered the most 
Important skills, filling out forms and attending meetings are least 
important. Furthermore, the top ranked items have the lowest standard 
deviations (show the greatest agreement) while the lowest ranked show 
the least agreement. 

Two rank changes are particularly evident in comparing the 1976 and 1979 
results. Public relations dropped in importance from third to seventh, 
while interpreting regulations rose from ninth to sixth. A third change 
of interest is the level of agreement about proposal writing — although 
its importance rank changed little (tenth to ninth), the degree of agree- 
ment increased markedly (standard deviation of 2.05 in 1979 but 4.12 in 
1976). Thus, in 1979 the respondents considered interpretation of regu- 
lations to be much more important than the 1976 respondents did, and also 
agreed much more on the level of importance they assigned to proposal 
wr it ing . 

2.2 Table 2 shows the skill levels the respondents assigned to the 
activities named in Table 1. Again, the first column gives the mean 
rating (from high to low) , while the second column gives the standard 
deviation. In terms of skills, the top items are "filling out forms," 
"disseminating information," and "organizing activities." The areas of 
relatively lowest skill are "seeking money," "public relations," and 
"needs id en t if icat ion. " 



There were five activities that changed in skill rank by three levels or 
more, comparing 1976 and 1979 results. The 1979 respondents rated their 
leadership skill four ranks lower (two dropped to six). Public relation 
declined by 3.5 ranks (8 to 11.5). However, three activities had higher 
ranks ~ organizing rose 3.5 ranks (6 to 2.5), attending meetings rose 
five (nine to four) , and proposal writing rose three (12 to 9) . 




Table 2. Ranking of Activities: Skill Level 





•r\^ L. JL V ^ 1. V 


Mean 


S .D . 


1. 


Fill Out Forms 


8.53 


1.87 


2.5 


Information Dissemination 


8.31 


1. 69 


2.5 


Organize Activities 


8.31 


1.60 


4. 


Conducting Meetings 


8.26 


1. 67 


5. 


Interpret Regulations 


8.19 


2.00 


6. 


Provide Leadership 


8 .10 


1.42 


7. 


Developing Plans 


7.93 


1. 60 


8. 


A 1 1 end Mee t ing s 


7.75 


2.42 


9. 


Write Proposals 


7. 60 


1.84 


10. 


Fight for Money 


7.46 


2. 22 


11.5 


Public Relations 


7.45 


2.11 


11.5 


Identifying Needs 


7.45 


2.11 



2.3 Table 3 presents an ordered list of the differences between the 
activities' importance ranks and their rank in terras of skill level. The 
activities with the greatest discrepancy between Importance and skill 
provide a way to identify training needs as reported by the respondents. 
The greatest difference exists for Identifying needs and providing 
leadership. Thus, there appear to be continuing needs for training in 
the areas of needs analysis and providing leadership. Needs identifica- 
tion training was also first in 1976, but leadership training was not an 
item with appreciable discrepancy between Importance and skill. 



Table 3. Training Needed: Rank Order of Largest Negative Rank 
Differences of Activities'^ 





Activities 


Rank Difference 


1. 


Identify Needs 


-7.5 


2. 


Provide Leadership 


-5.0 


3. 


Develop Plans 


-5.0 


4. 


Public Relations 


-4.5 


5. 


Fight for Money 


-2.0 



* Results are computed by subtracting skill rank from importance rank. 



2.4 In Table 4, a rank ordering is given of the top five largest dif- 
ferences found in subtracting the mean skill from the mean importance 
ratings. This is an alternative approach to assessing areas of greatest 
training needs from the one in Table 3. Providing leadership and identify- 
ing needs are the two activities whose mean importance exceeds mean skill | 
the largest amount. 
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Table 4, Ranking of Largest Negative Mean Differences: Activities^ 





Ac t Iv i t ie s 


Mean Differences 


1. 


^rovlde Leadership 


0.87 


2. 


identify Needs 


0.81 


3. 


Develop Plans 


0.62 


A. 


Public Relations 


0.44 


5. 


Fight for Money 


0.37 



* Results computed by subtracting the mean skill level from the mean 
importance . 

3. 0 Training Needs Suggestions 

The responses to the four open-ended questions were analyzed by collating 
all replies to each question, and then examining the replies to discuss 
the number of different comments that were made. In addition, the number 
of persons makin^^ ac least one conmient for a question was also noted- All 
conraients are fou id in Appendices B - E, 

3.1 Community Resource Guide Development 

Comments were made by about 50 respondents. Their full replies are 
repeated in Appendix B. Reactions to this topic fall into several dis- 
tinct categories. Some respondents did not consider the topic a worth- 
while one to pursue, principally because they reported already having a 
guide in hand. However, the majority were in favor of training in this 
area. Their interests lay in two areas. Some wanted assistance in the 
preparation of a guide, while others wanted help in getting it implemented. 
A few suggestions were made that the pu^'^ be prepared by external sources. 
Thus, it appears that training in c ixuy Resource Guide development 

would be attractive to over hall che respondents, The training should 
include "how to prepare" assistance, and "how to implement" assistance. 

3 . 2 Needs Assessment 

About three-fourths of the respondents indicated that needs assessment 
training was needed. However, their approval of the topic was often 
strongly qualified. (See Appendix C for full comments from 50 respon- 
dents.) For needs assessment training to be well-received, it should be 
practical, useful, specific and directive. Usable instruments should 
be provided that participants could take away and implement in their own 
setting. Basic, general reviews of needs assessment were not frequently 
endorsed. In fact, those who argued against needs assessment training 
often used the argument that they anticipated that their only exposure 
would be to such elementary in-service, and hence did not see that as 
useful . 
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3 . 3 Area-wide Intern Program 



The comments for this question are given in Appendix D. Overall, it 
received only scattered enthusiasm as an in-service or training topic. 
A sizeable number of respondents reported that they were unfamiliar with 
the term at all. Others mentioned a variety of major stumbling blocks 
they perceived — reduced staff levels, transportation, funds, etc. Only 

a few of the comments indicated a specific meaning for the term and 
approval for more assistance. It appears that the need for in-service 
or training is at the preliminary awareness stage, to disseminate the 
concept as perceived by MDE staff before attempting to convey more 
operat ional details . 



3 . 4 Area -wide Job Placement /Job Bank 

Comments to this question are found in Appendix E. Overall, this topic 
was received highly variably by the respondents. The desire for assis- 
tance was matched by individuals who felt that no emphasis should be 
given to the topic. Those who sought assistance mentioned the need for 
help in constructing an entirely new placement bank, or had requests 
tailored to problems specific to their currently operating system. 
Individuals who declined assistance cited reasons such as the existence 
of their own system or thej_r participation in other systems, such as the 
Michigan Occupational Information System (MOIS) . For this topic, it 
appears that highly specialized infomnation is needed, tailored specifi- 
cally to the problems that confront individuals, and ranging from basic 
to quite sophisticated needs. 

3-5 Responding to requests to four areas where training by MDE is under 
consideration, the persons who completed this study generally favored 
assistance in all four areas. However, their expressed needs differed 
between areas. For Community Resource Guide development, training should 
focus on how to prepare and implement the guide. Needs assessment train- 
ing will be welcomed to the degree it provides direct, specific and 
immediately useful results. Training on intern programs should focus on 
the basic principles, benefits, and expectations underlying the basic 
concept. Finally, job placement/ j ob bank training should be preapred in 
such a way that it can be adapted to rather heterogeneous needs. 



4 . 0 Network Analysis Results 

4.1 The respondents were asked to complete a portion of the questionnaire 
dealing with the frequency of their interaction during the previous six 
months with the individuals whose names were provided to the contractor. 
There were 74 persons on the list. The interaction topics dealt with 
"my job,'' "career education" and "CEDISS." The instrument asked for an 
estimate of their frequency of interaction on each topic in the past six 
months . 



Since about three-fourths of the respondents named on the network ques- 
tionnaire completed the instrument, all communication links reported were 
used in the analysis, rather than reciprocated links only. This enabled 
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an estimation of the importance of the 13 missing individuals in the over- 
all network. This reduces the reliability estimated for any single link, 
but is more likely to maintain the overall pattern of interaction. 



4.2 The results of separate analyses of the communication networks for 
"my job," "career education," and "CEDISS" are presented below in Table 
5. In general, the results show that a large proportion of these 
individuals are linked together by their communication patterns. In 
contrast, the 1976 results showed networks that were much less well-linked. 



Table 5. Network Summary 



Role 


My 


Job 


Career Education 


CEDISS 


Group Members 


43 


+ 17 


69 


71 


Liaisons 




7 


0 


0 


Bridges* 


34 


+ 17 




0 


Others 




3 


2 


0 


Isolates 




4 


3 


3 



* Bridges are group members, and hence are not included in column totals 
(N = 74) . 



4.3 Individuals are assigned different roles as a result of their inter- 
action patterns. Dense clusters of links become groups . Single individ- 
uals linking groups are called liaisons since they provide a means by 
which information may be exchanged between two groups. Certain group 
members are linked to other group members in other groups, and are refer- 
red to as br idges . Other persons have no links and are referred to as 
isolates . 

4.4 In the "my job" network two groups were identified. One had 43 
members and the other had 17. There were seven individuals whb served 
as liaisons — connecting the two groups but not formally a member of 
either. The two groups were also heavily connected by links between 
group members (bridge links). Consequently, while there was some dis- 
tinctive grouping among the 74 persons, the overall pattern is one of 
reasonably frequent linkages. 

4.5 The networks for "career education" and "CEDISS" were undifferen- 
tiated, i.e., almost all respondents belonged to one large grouping. 
This suggests there are fairly extensive patterns of connection among 
the respondents, but there is not sufficient structure to indicate the 
presence of some members who play central roles in passing information 
to and from others. 

4.6 There were a small number (3-4) of isolates (persons who named no 
one else, and vice-versa) in the three networks. 
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5.0 Recommendations 



The recommend at ions will focus on the training and in-service needs of 
the CEPD coordinators. 

5.1 The job perception analysis provides several suggestions for train- 
ing needs analysis. If "need'* is operationally defined as an activity 
where an assigned Importance level exceeds by some margin the skill level 
that is assigned, then "identifying needs" and "provide leadership" are 
the cwo major areas to consider. 

Interestingly, both topics were important in 1976 as well. Some workshops 
on needs analysis and some generalized leadership training were provided. 
But personnel turnover, changing needs, and the passage of time have con- 
tributed to the persistence of these needs. 

5.2 Another training need indicated in the activities analysis is regu- 
lation. It has became relatively more important in the past three years. 
The topic suggests that training on the content and interpretation of 
existing and proposed regulation impacting Career Education is warranted. 

5.3 The training suggested by the respondents in the area of Community 
Resource Guide development, needs assessment, intern program, and job 
placement/ job bank is detailed in Section 3, and summarized in 3.5. The 
respondents' comments indicate a willingness to participate in training 
in each of these areas, provided it is structured appropriately. 

5.4 The network analysis results suggest that CEPD coordinators lack 

an emergent structure of linkages that would make efficient introduction 
and dissemination of information possible. At present, there do not 
appear to be key "entry points," i.e., individuals who offer rapid access 
to others by virtue of the connections the individual has. 

Thus another training/ in-service possibility is in the area of group 
process and team-building. Activities could be developed to provide 
CEPD coordinators with regularly exercised opportunities to interact, 
exchange information related to career education, and assist one another 
in the solution of relevant problems. 
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High/Scope Educational Research Foundation 
Project CEDISS Evaluation 

A REPORT ON THE RESULTS OF HIGH/SCOPE'S 
FINAL SITE STATUS SURVEY 

July 20, 1979 
Background 



High/Scope, in its evaluation support role under Project 
CEDISS, administered a Site Status Survey approximately once 
per school quarter from fall, 1977 until spring, 1979. The 
final survey in this series was of special significance, since 
it asked participants to look back on their experience and 
draw some last conclusions about the project. This report 
presents the results of the survey. The actual survey form 
is attached as Appendix A. 



The Survey Sample 

In mid-May 197 9, just as the school year was coming to 
a close, the final Site Status Survey was sent to key parti- 
cipants in each of the 47 current CEDISS sites. "Key parti- 
cipants" included each site's CEPD and site coordinators and 
any other individuals who had been named earlier by the coor- 
dinators as playing significant managerial or oversight roles 
in the project. (In one site, for example, the curriculum 
coordinator for the local district was named as a third 
key participant . ) Altogether, the surveys were mailed to 106 
individuals at the 4 7 sites. A follow-up mailing was made 
in late May to those who had not yet responded to the first 
mailing. By early June, replies had been received from 89 
of these individuals — 84% of all survey recipients. The 
analyses reported here are based upon the responses of this 
sample of 89, 
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Design of the Survey 

The object of the survey was to gain a retrospective view 
of CEDISS from these veterans of the project. Since it was 
sent out at the end of the year, a busy time for school people, 
the survey was kept to three pages in order to minimize response 
burden. The questions addressed two main areas of interest: 

(a) the effectiveness of the various resources that MDE had 
made available to CEDISS sites as they carried out their projects 

(questions 1-3) and (b) the effectiveness of the local project 
itself, in terms of its impact on school problem-solving 
and on the use of educational products (questions 4-6) . 



Results 



Respondent Profile 

The survey asked each individual to categorically identify 
his or her main professional role outside of CEDISS. Figure 
1 shows the distribution of responses. Also shown in Figure 1 
is the breakdown of respondents by CEDISS function (CEPd' 
coordinator/site coordinator/other) . The role most heavily 
represented is that of ISD Vocational-Technical Specialist 
(29% of all respondents placed themselves in this category) . 
ISD Career Education Coordinator is next (15%) . Virtually all 
CEPD coordinators identified one or the ^ther of these two 
categories as representing their main professional role. 
Site coordinators, however, are more diverse. They may be 
principals, teachers, counselors, or local district personnel. 
No more than 14% of the respondents fell into any one of these 
categories, but overall, those with roles defined at the local 
level outnumbered those at the ISD level, 53% to 47%. 

Site coordinators constituted 50% of the total sample, 
CEPD coordinators, 42%, and others, 8%. This means that site 
coordinators were somewhat more conscientious about responding 
than their CEPD counterparts, since if all survey recipients 

^Not all respondents answered all the questions in the survey. 
The number responding to each question is shown in adjacent 
parentheses in the attached figures. The percentages given 
in the figures represent percentage of all those responding to 
the particular question . Thus the percentages always sum to 
100, even if a given question was not answered by everyone. 
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Figure 1 



Professional Roles of the 
Survey Respondents (N=8 8 ) 

ISD Vocational-Technical 
Specialist 

ISD Career Education 
Coordinator 

Other ISD position 

Local district Vocational- 
Technical Specialist 

Local district Career 
Education Coordinator 

Principal 

Teacher 

Counselor 

Other local district or 
school position 

CEDISS Functions of the 
Survey Respondents (N=89) 

CEPD Coordinator 
Site Coordinator 
Other participant 



% in Each Category 
0 10 20 30 40 50 60 



29% 



25% 



3% 



6% 



11% 



14% 



9% 



8% 



5% 



42% 



50% 



8% 




If 



had answered, the two groups would have been equal in size. 
No significant differences were found among people from 
these different groups in the answers they gave to the main 
questions posed in the survey. Thus in the following analyses 
no distinctions are made among categories of respondents. 

Question 1: Degree of Need for Outside Help at Each 
Step in the Problem-Solving Pro cess^ 

Respondents typically report that they need only "a 
little" outside help to accomplish three of the six steps in 
the prcpblem-solving process: identifying goals, defining 
specific needs, and implementing the products or solutions 
selected. "A fair amount" of outside help is required for 
the other three steps: searching for a product/solution, 
selecting among the products/solutions found/ and evaluating 
the product/solution implemented. On the basis of the results 
pictured in Figure 2, it seems safe to say that CEDISS sites 
feel the greatest need for help in undertaking a search for 
products: 84% of all respondents desire "a fair amount" or 
"a lot" of assistance in that. 

Question 2: Degree of Need for the Resources that Have 
Been Provided Under CEDISS^ 

Those answering said that if they were beginning the 
problem-solving process again, they would want more training 
(both on site and at outside workshops) , more products to 
choose from, and more time to complete the project. They 
would want about the same amount of consultation with MDE 
staff, with others hired by MDE, with ISD staff, and with 
local district staff. In regard to the amount of funds 
required, half said that they would need no more than they had 
this time? but 20% said they'd need "a little more" and fully 
30% said they'd need "a lot more." 

An examination of Figure 3 shows that the two most prominent 
needs reported are for training on site (25% would ask for "a lot 
more") and for curriculum products (30% said "a lot more"). 

^The median response to each of the questions in the survey is 
marked in the figures by an asterisk. The asterisk is placed 
at the point dividing the lower 50% of all respondents from 
the upper 50%. For practical purposes, the answer given by 
the median respondent may be taken as the "typical" answer to 
that question. This typical answer is indicated in the figures 
by an arrow {-^) . 
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Question 1 



SUPPOSE YOUR SITE WERE JUST NOW BEGINNING THE 
CEDISS PROBLEM-SOLVING PROCESS. HOW MUCH OUT- 
SIDE HELP (FROM MDE OR ELSEtfflERE) WOULD YOU 
WISH FOR AT EACH STEP? 



CEDISS Problem- 
Solving Step 



Identifying Goals 
(N=88) 



% Responding as Indicated 
0 10 20 30 40 50 60 



None 

A little 

A faiv amount 

A lot 



\ 14% 



J 11% 



29% 



Defining Specific 
Needs (N=86) 



None 

A little 

A fair amount 

A lot 



\12% 



29\ 



50% 



Searching for a 
Product/Solution 
(N=87) 



None 

A little 

A fair amount 

A lot 



8% 
8% 



46% 



38% 



Selecting Among 
the Products/ 
Solutions Found 
(N=88) 



None 

A little 

A fair amount 

A lot 



~\14% 



J 15% 



34: 



37% 



Implementing the 
Products/Solutions 
Selected (N=87) 



None 

A little 

A fair amount 

A tot 



~\13% 



JTT'. 



24% 



] 52% 



Evaluating the 
Product/Solution 
Implemented (N=8 7) 



None 

A little 

A fair amount 

A lot 



5% 



22', 



46% 



\27% 



*Median case 

•*■ Category containing the median case 
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Question 2: IF YOUR SITE WERE BEGINNING THE PROBLEM- 
SOLVING PROCESS AGAIN, WOULD YOU WANT MORE 
OR LESS OF THE FOLLOWING RESOURCES THAN 
YOU ACTUALLY HAD? 



Responding as Indicated 
10 20 30 40 50 60 



Resources 



Training at MDE ' s 
CEDISS Workshops 
(N=84) 



A tot less 

A little less 

The same 

A little move 

A lot move 



5% 



9% 



19% 



\2S% 



42% 



Training on Site 
(N=84) 



A lot less 
A little less 
The same 
^ A little move 
A lot move 



\l% 
0% 



27% 



\25% 



47% 



Consultation 
MDE Staff (N= 


With 
= 87) 


A Zot less 

A Z-ittZe tess 


~\2% 
4% 






-> The same 




^44% 




A Zi-ttZe moi'e 




\41% 








A Zot move 


1 9% 










A Zot Zess 


~\2% 






Consultation 


With 


A littZe Zess 


1 6% 






Others Hirad 


by 


-y The same 


I 


MDE (N=85) 




A Z-CttZe more 




1 32% 








A lot more 


5% 







Consultation With 
ISD Staff (N=72) 



A Zot Zess 

A Z-ittZe Zess 

The same 

A Z-LttZe more 

A Zot more 



3% 

~[6% 



58 



29% 



\4% 





A lot less 


0% 






Consultation With 


A little less 


0% 






Local District 


The same 


* 1 


Staff (N=85) 


A little move 




37% 






A lot move 


, 7% 







*Median case 

Q Category containing the median case 
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A 
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Funds {N=85) 



A lot less 

A litt le less 

The same 

A Zitt Ze more 

A Zot move 



0% 
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30% 



Time to Complete 
the Project 
(N=87) 
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5% 
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Question 3; Usefulness of Resource s that Were Provided 
Under CEDISS 



There were no strong distinctions made among the resources 
inquired about h^re. All were judged "fairly" useful by the 
typical respondent, as can be seen in Figure 4. A few weak 
distinctions are apparent, though: Workshop 1 and High/Scope 
staff consultants were rated somewhat less useful than most 
other resources while Workshop 3 and MDE staff consultants 
were rated somewhat more useful. 

Question 4: Endurance of CEDISS ' s Effect on the Local 
Problem- Solving Process "~ 

As Figure 5 shows, 85% of all respondents affirm that 
CEDISS has had an effect on the process that people on site 
will follow in dealing with future needs. Respondents were 
asked to describe briefly any such effects • Their descriptions 
can be categorized as follows^: 

provided a sequential planning process (26) , 

provided a framework for solving problems (9), 

encouraged a team approach to solving 
problems ( 5 ) , 

brought about positive relationships between 
ISD and LEA (3) , 

identified needs (3) , 

provided an opportunity to learn from mistakes (3) , 

provided a useful checklist for reviewing 
products (2 } . 

Question 5: Endurance of CEDISS ' s Effect on Local Use of 
an Educational Product 

Only 7% of all those responding said that CEDISS had 
not yielded an enduring educational product. All the 
rest — 93% — declared that it had (see Figure 5) , The products 
described are too various to categorize^ but this sample of 
coimnents conveys a sense of the responses: 



^The numbers in parentheses refer to the number of individuals 
whose comments fall into each particular category. 
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Question 3 : 



HOW USEFUL WAS EACH OF THE FOLLOWING 
TO YOUR SITE'S PROJECT? 



% Responding as Indicate 
0 10 20 30 40 50 



Workshop 1 (Goal Setting 
and Needs Assessment) 
(N=71) 



Not at all 
A little 
Fairly 
Very 



11\ 



35% 



30% 



24] 



Workshop 2 (Identifi- 
cation, Review and 
Selection of Products) 
(N=80) 



Not at all 
A little 
Fairly 
Very 



10% 



22% 



34% 
34% 



Workshop 3 (Implemen- 
tation and Evaluation) 
(N=82) 



Not at all 
A little 
Fairly 
Very 



1 7% 










\16% 








* 


I 33% 




44% 



CEDISS Product 
Fact Sheets (N=84) 



Not at all 
A little 
Fairly 
Very 



111% 



']17% 



-k 26% 



J 46% 



MDE Staff Consultants 
(N==79) 



Not at all 
A little 
Fairly 
Very 



0% 



22% 



39% 
39% 



High/Scope Staff 
Consultants (N=67) 



Not at all 
A little 
Fairly 
Very 



19% 



26% 



18\ 



J 37% 



*Median case 



Category containing the median case 



Figure 5 



% Responding as Ind-iaated 
0 50 100 



Question 4 : 

DO YOU THINK CEDISS HAS HAD AN 
EFFECT ON THE PROCESS THAT PEOPT.E 

IN YOUR sit:, will follow in 

DEALING WITH FUTURE NEEDS OR 
PROBLEMS? {N=86) 



'es 



No 




85% 



Question 5 : 

DO YOU THINK THAT CEDISS HAS 
HELPED TO PUT TOGETHER A PRODUCT 
(FOR EXAMPLE, A CURRICULUM PLAN) 
THAT WILL REMAIN IN USE AFTER THE 
PROJECT IS OVER? (N=8 8) 



Yes 



No 




Question 6 : 

HAS CEDISS HAD ANY OTHER EFFECTS ■> Yes 

YOU CAN THINK OF (FOR EXAMPLE, 

ON PEOPLE OR SCHOOLS THAT WERE 

NOT PART OF THE ORIGINAL PROJECT) ? No 

(N=80) 



* 




32% 



68% 



♦Median case 

Category containing the median case 
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"The MaKnight product ue'i^e usiyzg will he continued 
-in 8th grade and expanded to 9th next year. " 

"The product we chose had successful results and we plan 
to incorporate it into next yearns curriculum (on a 
voluntary basis though)." 

"We will be using the ACT Career Planning program again 
next year with juniors . " 

"We are planning in-services in fall to help teachers 
gain skill in using materials we have gotten." 

"A career education unit in English. Creation of a 
Career Resources Center." 



"The career exploration and decisici process and the 
employ ability skills process witl ^c: -.e a part of our 
curriaulum , " 



Question 6: Other Effects of CEDISS 

Slightly more than two thirds of the respondent-^: (see 
Figure 7) answered that CEDISS had produced effects other 
than those referred to in questions 4 and 5 . Their descriptions 
of these effects can be reduced to: 

other teachers in the building or district will 
use the materials/procedures (15) , 

other districts will use the xnaterials/procedures (6), 

others were made aware of career education (5) , 

community is more aware of career education and 
more involved in the curriculum (4) , 

school climate or teachers' enthusiasm was 
enhanced (4 ) , 

the site will be a demonstration site for the 
area/district (3) , 

school administrators are more positive toward 
career education (2) , 
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people began to talk across academic disciplines (1) , 
another career education grant was obtained (1) . 



Respondents' Final Comments 

The final question in the survey invited free-form comments 
of any sort on CEDISS. Here they are in synopsis: 

overall, project was too slow to start up and get 
organized (15) , 

information was lacking on what the project was 
about and how to begin (4) , 

excellent, well-planned project by MDE (4), 

project generally lacked organization (3) , 

project's timing was not synchronized with MDE ' s 
capabilities (2) , 

evaluation demands outweighed the activities 
evaluated (1) / 

needed more consistent contact between locaj. sites , 
ISD, MDE (1) , 

involvement of several organizations (MDE, 
High/Scope, Abt) was confusing (1) , 

funding should have been distributed more equitably (1) , 

funding should all have been available at the 
beginning of the program (1), 

there should have been fewer constraints on 
expenditures (1) , 

funding should have gone directly through local 
district (1) , 

too much was spent at the state level for adminis-- 
tration and evaluation (1) , 

needed more information on fiscal accounting (1) , 
needed better fiscal control at the state level (1) . 
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Summary 



The Sample 

Of the 107 survey recipients, 89 responded. This sample 
represents a large proportion of the CEPD coordinators, site 
coordinators, and other key participants who took part in 
CEDISS. The professional roles held by these individuals, 
beyond CEDISS/ are diverse. In spite of this diversity, 
however/ all groups were in close agreement on the issues 
posed in the survey. Thus the analyses reported here were 
based on the answers of all these respondents taken collectively. 

Effectiveness of the Resources MDE Provided Under CEDISS 

CEDISS participants report that -if they were just begin- 
ning the project now, they would request particular help with 
three steps in the problem-solving process: searching for a 
product, selecting a product, and evaluating the final result. 
If they could have had more of any CEDISS resources, they 
would have given first preference to training (especially on- 
site training) , products, and time to complete the project. 
It is notable also that while half of the respondents considered 
their funding adequate, the other half indicated a need for 
more funds — 30% said "a lot more." 

All the resources that CEDISS provided — at least all 
those listed — were judged "fairly" useful, with Workshop 3 
(which emphasized implementation and evaluation) and MDE staff 
consultants rating somewhat higher than other resources. 



Effectiveness of the Local Projects 

A large majority (85%) of respondents said that CEDISS 
had produced some enduring change in the local problem-solving 
process . The examples cited are various , but prominently 
include adoption of a sequential planning process (e.g., 
needs assessment, problem definition, solution search, ...) 
and a shift toward greater collaboration. 

An even larger majority (93%) reported that the products 
installed under CEDISS sponsorship would continue in use. 
In many cases, evidently, the products will be used differently 
in the future. In some instances, the product will be available 




as a curriculuiTi option to teachers , who then may or may not 
choose it. In other instances the product will be used at grade 
levels where it has not been used before. In still other instances 
the product materials will constitute a reference library that 
will remain available to those interested- These examples 
only begin to suggest the ways in which the future use of these 
products may depart from their original use under CEDISS. 

Finally, 68% of the respondents affirmed that there were 
effects of CEDISS beyond the preceding. In general, these 
were "spin-off" effects, involving the spread of CEDISS ' s 
influence to teachers, schools, or districts beyond the 
original arena of the project. 



Conclusions 



Considering the respondents* emphatic need for products, 
one might expect the CEDISS Product Fact Sheets to have been 
rated more highly than they were. The probable explanation, 
suggested by respondents' notes, is that the Fact Sheets came 
along after many sites had already selected their product. 
The Fact Sheets would clearly have been judged more useful 
if their delivery had been more closely synchronized with 
sites' needs. • Judging by other comments, better timing at 
the state level would have enhanced the value of many of the 
other resources that were offered, especially for the more 
advanced sites that needed assistance early in the project. 
Below, this conclusion and others are restated with an eye 
toward management of future programs like CEDISS. 



Need for Strategic Training 

Participants feel they need more help at some stages 
than at others — particularly in searching for products and 
evaluating their projects. They require training to carry 
them through these steps, and would probably prefer the training 
to be provided on site rather than in centralized workshops - 
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Timely Provision of Resources 



The resources that the state provides (such as products 
and training) are of greatest value at the moment when a site 
needs them. This means that the state must aim to develop its 
resources in time to be ready for the earliest-blooming sites. 
It can do this either by hastening the resources or by delayin 
the bloom. 



Need for Sustained Intervention at Critical Points 

Although respondents expressed a considerable need for 
evaluation support, very few sites accepted High/Scope's 
repeated earlier offers of such support. What this suggests 
is that participants cannot always be expected to take strong 
initiative in seeking the resources their projects require. 
Perhaps the state should intervene actively to provide support 
at critical points like these. Of course, this is just what 
the state did in organizing Workshop 3, but even so, many 
sites have still not followed through on evaluation of their 
projects. It may be that more sustained support and closer 
monitoring is necessary. 



Accomplishment of Change by Increments 

The survey indicates that the great majority of participants 
in CEDISS feel that the project made a positive and enduring 
contribution to school practice. In general, this contribution 
is not revolutionary but incremental — making things a little 
bit better than they were before. It follows that kindred 
future projects are likely to add their own enhancements to 
School practice, especially if they attend to the lessons 
conveyed by the CEDISS experience. 
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CEDISS REPORT 



PREFACE 



The primary purpose of the Michigan Department of Education CEDISS pro- 
ject (Career Education Dissemination) funded by the National Institute of 
Education was to disseminate research and development projects in career 
education to local education sites. The first step taken to accomplish this 
purpose was to identify career education products available for use by November 
1978. A total of 150 career education products were located and reviewed 

by the Office of Career Education, Michigan State Department of Education. 
A fact sheet was developed for each product reviewed. This fact sheet con- 
tained a description of the product, a report of the extent to which the 
product was biased, evaluation or research outcomes, and cost of the product. 
In addition to developing fact sheets for each product, samples of 150 pro- 
ducts were placed in the Michigan State Library to facilitate a "hands-on" 
review by interested local site staff. An example of the fact sheet is 
provided in Appendix A. 

The Michigan CEDISS project deals exclusively with career education and 
was concerned with assisting local sites in the identification of their career 
education needs and a possible solution to these needs. Using criteria estab- 
lished by CEDISS, CEPD (Career Education Planning District) nominated sites 
with needs in the area of instruction, guidance, and/or placement. A total 
of 46 sites were funded to receive CEDISS assistance. Each site selected was 
to clearly define its career education problems, select a career education 
product (s) from the 150 career education products reviewed by the State Depart- 
ment, and designate a plan to implement and evaluate the product. The Michigan 
Department of Education provided a series of workshops focusing on problem 
identification, product selection, and evaluation methodology. 

At the request of the Michigan State Department of Education, three 
evaluation reports were prepared. Encompassed within the three reports were 
three objectives. Each objective corresponds to one of the reports. The 
first objective is to provide an overview or descriptive summary of the pro- 
ducts selected for use by the CEDISS sites including topics such as: problem 
area addressed, methods of Implementation, evaluative information, instru- 
mentation used in the evaluation and, finally, a summary of the overall find- 
ings relative to CEDISS products in general. 

The second objective, and the topic of the second report, is to provide 
an overview of the CEDISS project and the problem areas within career educa- 
tion addressed by the project. The problem areas have been divided according 
to the method used to solve the problem, i.e., whether the problem will be 
solved through instruction, guidance and counseling, or placement. 

The third objective, and topic of the third report, is to provide a 
handbook for future users of programs such as CEDISS with guidelines to help 
the project staff design and implement a successful project. 

Two primary sources of information were used to obtain information needed 
for the three reports. The first is the evaluation reports submitted by each 
of the sites. (These reports were available for forty of the forty-six sites.) 

O 
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The second source of information was Carol Wolenberg, Educational Consultant 
to the CEDISS project. Carol Wolenberg provided information concerning her 
experiences with the CEDISS projects as well as documents produced by the 
Office of Career Education which contained information relative to the three 
objectives just stated. 

The first of the three reports comprises this document. The second and 
third reports may be found bound together in a separate volume. The evaluators 
would like to thank Carol Wolenberg and the Michigan State Department of Edu- 
cation, Office of Career Education for the information and help provided in 
the writing of this report. 

Finally, a brief summary of the products used is included in the first 
report as Appendix B. Included in Appendix B is information relative to 
schools using the product, evaluation results, and costs. 



Report 1: CEDISS Product Summary 



A total of 46 different sites participated in the CEDISS program. Of 
those 46 sites, however, the evaluator was sent product summaries from only 
40 of the sites (86.9%). The 40 sites used a total of 30 different CEDISS 
products. Counting products used more than once, the 40 sites utilized a 
total of 51 products. These products address a wide range of concern in the 
area of career education. In order to more fully describe the CEDISS pro- 
ducts, information will be presented in three major areas: 

1. Product description 

2. Product implementation 

3. Product evaluation 

Within each of these three areas, data are summarized across all 30 of the 
products. 



A. Product Description 

In order to obtain complete descriptions of the types of products used, 
it is necessary to discuss several topic areas. These areas are: 

1. Type of product developer, i.e., local state, federal or commercial; 

2. Problems addressed by the products; 

3. Methods used for implementing the products; 

4. Range of product costs; and 

5. Intended product outcomes. 

The remainder of this section will be broken down into these categories: 

1. Type of Developer : As stated previously, 30 different CEDISS products 

were submitted to the evaluator for analysis. Table I provides a break- 
down of the develoj^ers of the 30 products. 



Table I: Type of Developer 



Developer Type 



Number 



Percent 



State 

Federal 

Commercial 



6 
4 
20 

Number =30 



20.0 
13.3 
66,7 

100% 



Table I indicates that the greatest number of products used by the CEDISS 
sites were developed and marketed by commercial publishing companies. Two- 
thirds of the 30 products came from this source. Six (20%) of the products 
were developed through state programs. The remaining 4 (13%) products were 



developed through direct federal funding. Although all of the products met 
the Project criteria regarding evaluation history and freedom from bias, the 
ten funded through federal and state programs are considered the result of 
research and development efforts. 

2. Problem Area Addressed ; An analysis of the problem areas addressed by 
the products revealed that many of the products addressed more than one 
problem area. The most common areas addressed by the products examined 
were self awareness, awareness of others, and career awareness. 

Table II provides a listing of the problem areas addressed. It should 
be noted that since a single product may address more than one problem area, 
figures presented in Table II represent the number and percentage of reports 
that address each problem area in whole or in part. 



Table II: Subject Areas Addressed by Projects 



Subj ect 


Number 


Percent 


Self -Awareness/Awareness of Others 


15 


30 


Career Awareness 


8 


16 


Decision-Making/Career Planning 


4 


8 


Interpersonal Skills 


5 


10 


Reading Skills 


4 


8 


Life Role Awareness 


3 


6 


Reduction of Sex Role ; lireotyping 


2 


4 


Problem Solving Skills 


1 


2 


Career Exploration 


1 


2 


Physical Fitness/Health 


1 


2 


Goal Setting 


1 


2 


Interdependence of Jobs in Society 


1 


2 


Transfer of Learning from School to Job 


1 


2 


Attitudes Toward Work/Self and Others 


1 


2 


Leisure Time and its Relation to Career 






Exploration and Decision Making 


1 


2 




Number = 50 


1007o 



Table II shows that the problem areas addressed by the CEDISS products 
can be grouped into 15 different areas. These areas represent a myriad of 
topics enabling a school to use the products to assist them in a variety of 
career education problems. 

Table II also Indicates that the four most commonly addressed problem 
areas, i.e.v self awareness and awareness of others, career awareness, deci- 
sion makiiig cind career planning, and interpersonal skills accounted for sixty- 
four percent of the problem areas addressed by the 30 different products. 
This indicates that the products chosen by the CEDISS sites emphasize these 
r.kllls is important aspects of career education. 




Implementation : A majority of the products examined were implemented 
primarily through teacher instruction, discussior, and student workbook 
activity. The variety of implementation methods used is indicated in 
Table III and reflects the diversity of the career education materials 
available to Michigan schools through the CEDISS programs. Again, it 
should be noted that a single product may have used more than one imple- 
mentation method. The percentages indicated in the table represent the 
percentage of products which used each of the implementation methods 
either as the only method of implementation or in conjunction with another 
or additional methods of implementation. 



Table 111: Methods of Implementation 



Method 

Classroom/Teacher !"^nstruct ion 
Discussion 

Workbook Type Activities 
Audio /Visual Presentation 
Resource Utilization 
Student Self-Instruc t ion 
Student Use of Existing Service 
Role Play 



Number 


Percent 


28 


A5.2 


10 


16.1 


7 


11.3 


8 


12.9 


3 


4.8 


3 


A. 8 


2 


3.3 


1 


1.6 


= 62 


100% 



Table III indicates that the predominate method of implementation was 
classroom teacher instruction. This accounted for about 50% of all implemen- 
tation methods used. Following classroom teacher instruction, the most com- 
monly used method of implementation was discussion groups resulting from 
classroom activities. The fourth most commonly ^:sed method of implementation 
was the use of the audio-visual equipment. This category might include 
methods such as presenting a filmstrip, listening to an audio cassette, or 
watching a television program. 

A. Materials Used : The CEDISS product reports identified various types of 
materials used in the implementation of the products. Very few of the 
products used only one type of the material, e.g., workbooks, filmstrips, 
etc. Table IV identifies the type of materials used for those products 
for which this information was available. Once again, it should be 
emphasized that the percentages reported represent the percentage of 
products utilizing each material type whether as the sole material used 
or as one material used in conjunction with one or more additional 
materials . 
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Table IV: Materials Used in Conjunction With CEDISS Products 



Material 



Number 



Percent 



Teacher's Guide (More than Directions: 

Resources, Suggested Activities, etc.) 
Audio /Visual Aids 
Texts/Pamphlets 
Workbooks 

Tests Provided with Product 

Ditto Masters 

Puppets 

Games 



19 
16 
12 
10 
3 
2 
1 
1 



29.7 
25.0 
18.8 
15.6 
4.6 
3.1 
1-6 
1.6 



Number = 64 



100% 



Table IV indicates that the four most commonly used materials were 
teachers' guides (containing more than just directions to the teacher), audio 
or visual aides, tests, and pamphlets or workbooks. These four material types 
accounted for 89.1% of all materials used. 

5. Cost of CEDISS Products : One strong point of Career Education materials 
made available by the Michigan Department of Education is low cost of a 
large portion of products. Approximately 58% of the products were priced 
at one hundred fifty dollars or less. This means that money saved on 
materials could be used in other areas of the CEDISS project. 

Table V is a summary of the cost of CEDISS products broken down accord- 
ing to an arbitrarily assigned cost range. The data presented in Table V are 
based on the 24 product reports which presented cost information. Six of the 
products (approximately 20%) did not report any cost information at all. 



Table V: Cost of CEDISS Products 



Cost Range Number Percent 

$1 - $10 3 12.5 

$11 - $25 2 8.3 

$26 - $50 ^ 16-8 

$51 - $100 3 12.5 

$101 - $150 2 8.3 

$151 - $200 20.8 
$201 - up 

Number = 24 100% 



It should be noted that the majority of prices were dated 1978. Although 
the prices of many of the products may have increased, the evaluator asserts 
that the ranges of product costs and distributions within these ranges have 
not been altered significantly within the span of one year. 
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6. Intended Product Outcomes : The stated kf\ o^^^o^^b the products 
used at the various CEDISS sit es correspy^^jf^ty ct^^^iy to th^ Second 
section of this report titled Subject Are^\^ S;^t^e^^ec3 by P^roject^- While 
section two dealt with the generic problA^ v/jr3^^ the Project 

sites, section six deals specifically wi^lV YjX i^^e^t^^^d ^^Pact on students 
of the product used. ^'^ 

Table VI is a summary of the intended i ^ ^;^t^ ^^t^^^^e^ tho^^ products 
for which this information was available. ^^f^ i^g^^^^g "^^b^^ VI, it is impo^^ 
tant to note that one product may have sevei^P viji^^^^^n^^ Out^^^^es. For exa^iple, 
a product may intend to improve self-awaren^\^ W^^J/^^ ^t ^He ^^^e tiU^^ hope to 
improve not only the career awareness of th^.^P'yjf\^t his at: her 

capacity to engage in a formal decision raaki/?\^ u'h^c^^^^. 1*b^ percen^^^Ses , 
therefore, represent the percent of products gAd^^e^'^ tl^-^^ outc^"^^ as the 

sole outcome of the product or as one of sev ^^t^^^i^^s the pr<^^^ct» 

Table VI: Intended Trc/\ f^J^\^\>^^xti^^ 



Outcomes 

Improved Self -Awareness 
Improved Career Awareness 
Improved Dec is ion-Making 

Job Seeking/Employability Skills Acquisitioi/ 
Integration of Self and Society/Family 
Improved Reading Skills 
Job Related Information Acquisition 

(tax forms, etc.) 
Better Able to Set Goals 
Reduced Career Sex-Stereotyping 
Problem-Solving Skills 
Communicat ion Skills 
Human Interactions Skills 
Learn About Physical Fitness/llealth 
Awareness of Varying Roles in Society 
Understanding of Job Satisfaction Role 
Familiar with Concept of Change 
Recognition of Role of Leisure Time 





Percent^ 


18 


30.0 


10 


16-7 


7 


11.6 


A 


6.6 


4 


6.6 


4 


6.6 


2 


3.3 


2 


3.3 


1 


1.7 


1 


1.7 


1 


1.7 


1 


1.7 


1 


1.7 


1 


1.7 


1 


1.7 


1 


1.7 


^ 1 


1.7 


= 60 


100% 



As shown in Table VI the three most cc/\ p ^^l^e^^^d °^tcoine^ are 

improved career awareness, improved self aw^Wf\^j^\ iinp^f^^Ved decision m^^-" 

ing skills. Almost all the products toucheav ^^^.\ l^^gt: On^ the ^hree 
outcomes. These three areas, as judged by t^y J^^<^^^ ^^le^^lng pr^^^^cts, 
are the three most important in helping the \^f<jf\\^^ best i^^ireer' 

choice. The reader should also note the artyi ;^r^^n^^d O^tcom^s? °f the 
products as listed in Table VI. This array W ^p^t^^i^'^ny to versatility 
of the products selected by the participat ii/wA\/h\^^ ^il^^s . This versatility 
enables CEDISS projects to adapt themselves \ ^\ iHxs/idu^'^ commui^ity needs 



of the community each school serves. 




In addition to the three most common impact areas, two other intended 
outcomes warrant special attention. The first is job seeking or employability 
skills acquisition, such as, filling out an employment application, how to act 
in an interview, the questions to expect in an interview, how to interpret 
a want ad, and how to keep a job once secured. As with the three most common 
product outcomes, this outcome is of high value to a student preparing to 
seek employment and the use of such materials should be encouraged. 

The second skill area worthy of special mention is that of reading skills. 
Four of the products had, as part of the intended impact of the product, the 
improvement of reading skills. The products intended to improve reading skills 
did so by providing levels of the product geared to different reading levels. 
Students may, for instance, read about a worker's perception of his or her 
job. Upon completion of this story, the student will be given a new story 
at a higher reading level. The intent is that as the student becomes involved 
in what he or she is reading, the increased difficulty of the reading level 
will help the student to improve his or her level of reading. The combination 
of improved career awareness with additional skills such as reading is another 
strong point of the CEDISS program. Again, the inclusion of basic skills such 
as reading within the programs such as CEDISS should be expanded in the future. 

7. Grade Levels Addressed : The final information presented to describe the 
career education products is the grade levels to which the products are 
targeted. It was found that many of the products, especially through 
education curriculum packets, were intended for use across the elementary, 
middle, and secondary curriculum rather than a specific grade as some of 
the2 products were. The data collected are summarized in Table VII. The 
data in this table indicate the percentage of products which were targeted 
III whole or in part at each of the grade levels listed. 



Table VII: Target Grade Levels of Products 



Range 


Number 


Per cent 


Preschool 


1 


1.5 


Kindergarten - Fifth 


20 


30.3 


Sixth - Eighth 


28 


42.4 


Nineth - Twelfth 


17 


25.8 




Number = 66 


100% 



Ta!ile VTI indicates that the majority of the products were implemented 
at the middle school level and belox>; (74.2%). The data presented indicate 
tho spread of products covered sufficient range to meet the career education 
notvis at all levels oF education. Again, thta is found to be a strong point 
of the CEDISS program* The use of career education mater lain at the elementary 
aaJ middle school level was shown to be effective by many of the programs. 
CEDISS shouJ.d he commended for providing a range of products which helps the 
development o career awareness by students at the middle school level and 
})elow . 




B, Types of Implementation 



Several factors influence the implementation of any program. A review 
of the CEDISS product summaries indicated that the factors important to CEDISS 
Implementation could be categorized according to the following labels. Level 
of the site, i.e., classroom, building, district, I.S.D., number of products 
used per site, duration of product implementation, i.e*, number of weeks, 
teacher training requirement prior to product implementation, and finally the 
curricula into which the product was implemented. Information will be pre- 
sented within each of these categories to provide an overview of the imple- 
mentation of the products that were involved in the CEDISS program. This 
overview will in turn provide the reader with an accurate description not only 
of implementation methods, but also of the time commitment and training commit- 
ment needed to successfully implement CEDISS products in general. 



Section One: Level of Site 



There are several levels at which any of the products examined may be 
used. These levels are either the classroom level which would indicate that 
one teacher was in charge of implementation of the product; the building level 
where two or more teachers may be responsible for implementation; the district 
level where several buildings are involved in implementation of the product; 
or the I.S.D. level where several districts are involved in the implementation 
of the product. Table VIII summarizes these data. 



Table VIII: Level of Implementation 



Level 


Number 


Percent 


Classroom 


7 


18.9 


Build ing 


23 


62.2 


District 


5 


13.5 


I.S.D. 


2 


5.4 




Number = 37 


100% 



The data presented in Table VIII are based on 37 of the 40 sites for which 
this information is available (92.5%). As shown in Table VIII the majority 
of the products were implemented at the building level* Again, the definition 
of building level was more than a single classroom involved in implementation. 
Often this was because the product was targeted at more than one grade level 
or because several classrooms were being used on an experimental basis to 
determine if the product was to be implemented at expanded levels in the 
future. The relatively small number of products which were implemented at 
the I.S.D. level or the district level reflect the fact that the CEDISS pro- 
gram was targeted at local schools. Again, this was a strong point of the 
CEDISS program as it provided CEDISS the opportunity t:o help schools with a 
career education program that was best suited to the needs of the community 
which the school serves. 
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Section Two: Number of Products Used Per Site 



The majority of sites Involved in the CEDISS program (65%) used only one 
CEDISS product. This means that 35% of the sites used two or more products. 
Only 5% of the sites used six or more products. The two sites using six or 
more products had chosen as their project setting up a complete career educa- 
tion resource center for use by the entire school or district* One such site 
has in their possession over 30 products. The most limiting factor in the 
number of products which one site could use was the available staff time to 
Implement the career education program. In those districts where resource 
centers were planned or curriculum packages were being implemented, sizeable 
amounts of staff time were utilized. In districts where this amount of time 
is not available, only one or two products can be considered for implementation. 

Table IX Indicates a breakdown of the number of products used per site* 
It should be noted that only six sites or 15% of the total number of sites 
involved used three or more products. In the case of those schools using the 
Coloma Curriculum Developing Package developed by the Coloma Public Schools, 
Coloma Michigan, a great deal of staff time was needed as the implementation 
was on the K~6 level. Seven schools were i.nvolved with the use of the Career 
Development Curriculum Package and these seven schools have been included in 
the category of one product used per site as the Coloma project was one 
product . 



Table IX: Number of Products Used Per Site 



Number of Products Used 



One 

Two 

Three 

Four 

Five 

Six or More 



Number 



Percent 



26 
8 
2 
2 
0 
2 



65.0 
20.0 
5.0 
5.0 
0.0 
5.0 



Number = AO 



100% 



Section Three: Duration of Product Implementation 



Several levels of product implementation were examined. The category 
encompassing the greatest amount of time is the number of weeks of implementa- 
tion. Where possible, information on number of implementations per week and 
the length of the implementation was also collected. This information was 
collected to provide an overall idea of the time invested by the schools in 
the career education program. Table X provides information concerning the 
duration, weeks or months, of product implementation. Although several sites 
may have used the same product, it was often the case that different schools 
may have used the same product for different periods of time. Thus, the data 
are provided by site for each product. Table X is a summary of these data. 
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The data were calculated on 47 of the 51 sites that provided the information 
concerning the duration of product implementation (92.2%). 



Table X: Duration of Product Implementation 



Weeks/Months Number Percent 



Less than one week 


5 


10.6 


One to three weeks 


3 


6.4 


Four to six weeks 


4 


8.5 


Seven to nine weeks 


11 


23.4 


Ten to twelve weeks 


11 


23.4 


Four months 


9 


19.2 


Eight months 


2 


4.3 


One year 


1 


2.1 


Continuous: used in Self Directed Activities 






at Times of Student Choice 


1 


2.1 




Number = 47 


100% 



Table X shows that approximately half of the products were implemented 
for a period of nine weeks or less with 72,3% of the products being imple- 
mented for 12 weeks or less. This translates into the fact that roughly 3/4 
of the products were implemented for a period of one half year or less. 
Relatively few products were implemented longer than five months or less than 
one week. Those products that were adoptf^d for a period of longer than five 
months were products which presented an entire curriculum package to be inte- 
grated into the current curriculum. Those products being implemented less 
than one week were usually "one shot^' programs designed particularly to be 
used over a short period of time. 

Of the 47 product reports that contained information regarding the dura- 
tion of product implementation, 25 presented information regarding the number 
of implementations per week (53%). It was found that over half of the products 
that reported this information used the career education product only one 
time per week. The next largest number of implementations per week was the 
use of the product on a daily basis of five times per v/eek. Table XI sum- 
marizes the information collected regarding the number of implementations par 
week of the products who reported this information. Further investigation 
into the question of implementation of products revealed that of the 25 product 
summary reports that did have implementation information concerning the number 
of implementations per week of the product, 16 of those or 64% presented 
information concerning the length in minutes of each product implementation. 
The overwhelming majority (91%) indicated that implementation occurred for 
sixty minutes or less each time the product was used with 47% indicating that 
th& implementation lasted thirty minutes or less. 
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Table XI: Number of Implementations Per Week 



Number of Implementations/Week 



One 
Two 
Three 
Four 

Five 



Number 

13 
2 
2 
1 

7 



Percent 

52,0 
8.0 
8.0 
4.0 

28.0 



Number = 25 



100% 



To summarize the product implementation information, it can be said 
that the average product or the product most commonly used by the CEDISS 
sites lasted for a duration of from 7 to 12 weeks, and was implemented on a once 
a week basis for thirty minutes or less. 



Section Four: Number of Individuals Used Per Site and Training Requirement 



Information was summarized when available concerning the number of 
individuals involved in product implementation and the training requirement 
for these individuals prior to their implementation of the product in their 
classroom. This information is presented to more fully describe the scope 
of the CEDISS program and the involvement on the part of the individuals 
presenting the product to the students. 

Table XII presents information concerning the number of individuals 
involved in product implementation per site. It should be noted that in 
many instances individuals were used as control teachers, i.e., teachers not 
using the product but whose class is being tested as a comparison group. 
These individuals have been included in the tabulations due to the fact that 
many of the schools did not differentiate between which teachers were used 
as the control group and which were not. To provide consistency then, all 
teachers listed as included in the product implementation have been included 
in the summarization of Table XII. 



Table XII: Number of Individuals Involved Per Product Per Site 



Number Number Percent 



One 


8 


18.6 


Two 


8 


18.6 


Three 


5 


11.6 


Four 


9 


21.0 


five 


5 


11.6 


Six 


0 


0.0 


Seven or More 


8 


18.6 




Number = 43 


100% 
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The information presented in Table XII represents information avallnhLe 
for 43 of the 51 possible product summary reports (84.3%) while the larj:;csL 
percentage of teachers per site correspond to those sites having four teachers 
involved in the implementation. Table XII indicates that there was generally 
an even spread among the number of sites using one individual to implement a 
product and those using more individuals per site. Again, those sites using 
seven or more individuals to implement the product were using products that 
were most often curriculum development package or complete resource centers. 
In cases such as these, the individuals involved in product implementation 
were not only teaching staff. For example, staff from the library might have 
been included as well as other specialized staff who provided services to the 
school . 

In many cases, training was required or provided to the individuals who 
would be implementing the product. The training sessions were most often 
conducted in three ways: inservice by developers of the product; inservice 
by current staff who had been inserviced before or who had previous experience 
with the product; and finally, through observation of the product being used in 
another site. 

Twelve product reports (40%) indicated the training was crucial prior to 
product implementation. In all twelve cases training was received. Fifteen 
product reports (50%) indicated that the product did not require special 
training. Of these fifteen, however, product specific training was received 
in six instances anyway. Three products or 10% did not indicate if training 
was required. 



Section Five: Month of Initial Implementation 



i 

This information was presented to indicate the time of the school year 
during which projects reporting this information began implementation. Such 
information is important as it indicates some constraints which may have been 
put on the project as a result of when projects were begun. Twenty-three of 
the fifty-one product summary reports reported this information (45.1%). Table 
XIII indicates that 95.6% of the projects started in January or after. For 
those projects which reported this information, the data in Table XIII show 
that a considerable start-up time was ueeded prior to project implementation. 
These data may indicate that start-up time should be an important consideration 
when planning future CEDISS projects. 



Month 

September 

January 

February 

March 

April 




Table XIII: Month of Initial Implementation 



Number Percent 

1 4.3 

10 43.5 

4 17.4 

1 4.3 

7 30.5 



11 



Number = 23 100% 



Section Six: Curriculum into \^ich CEDISS is Integrated 



The final area to be discussed is the curriculum into which the products 
were implemented. The intent of gathering this information was to provide in- 
sight into which curriculum the career education products might be most easily 
integrated. However, only seven o" the product reports (13.7%) provided this 
information. Within these seven, nowever, the breakdown is as follows: 
elementary curriculum 1, social studies curriculum 3, English - communication 
arts 3. In the future it is important that this information be reported as 
it will help to determine in which curricula areas future career education 
products should be implemented* 



C. Results of Implementation 
1. Evaluation Results 

Evaluation results need to be reported on two levels. The first level 
is the product level. In all, thirty different products were evaluated by the 
40 sites which submitted project reports co the evaluator. The results of the 
evaluations for each product will be presented in the second part of this 
report- General information, however, will be presented here. The second 
level of evaluation which needs to be discussed is how much evaluation was 
performed. Counting different sites who used the product, a total of 51 pro- 
ducts could have been evaluated. General results for 51 possible evaluation 
will be presented also. 

In reference to the general results , the evaluation of the 30 different 
products, the following information was found. Of the thirty products, 24 
(80%) had evaluation data presented for them. Next, the quality of the 24 
evaluations was studied. The operational definition of quality or appropriate 
evaluation u«ed was: an evaluation design utilizing methodology for which 
information concerning the degree of program impact may be assessed. Only 
eight (33.3%) of the 24 evaluation designs provided enough information to 
indicate that the evaluation design would indeed provide the needed informa- 
tion. Another four (16.7%) of the evaluation reports did not provide enough 
evaluation to be certain the design was appropriate. Finally, ten of the 
twenty-four evaluation reports (41.7%) provided enough evaluation design 
information to determine that the design was inappropriate for the purpose 
needed . 

As mentii^ned earlier, the second level of evaluation is the quality and 
level of evalvjation occurring at the site level. A total of 51 evaluations 
could have been performed if every site evaluated all the products they had 
used. Thirty nine (76.5%) of the 51 possible reports reported any type of 
evaluation data regardless of the quality. Of these 39 reports, a total of 
27 (69.2%) of the product evaluations reported positive results. This figure 
is used without regard to the quality of the evaluation due to the limited 
information concerning evaluation quality availab].e as reported by individual 
site evaluation summaries. 



EKLC 



12 



^ L 



2 . Instrumentation 



Evaluations of the CEDISS programs on the local level were almost always 
conducted using some form of instrumentation. For this reason, information 
regarding the instrumentation used will be summarized in this section. Two 
sots of data can bo used to describe the instrumentation, the Hource of the 
Instrument, I.e., commercial, locally developed, etc., and the type of Instru- 
ment, i.e., achievement test, interviews, etc. Tables XIV and XV summarize 
these data. 



Table XIV: Sources of Instruments Used 



Source 



Number 



Percent 



Locally Developed 
Product Publisher 
Commercially Developed 
Unable to Determine 



34 
11 
5 
3 



64.2 
20.8 
9.4 
5.6 



Number 



35 



100% 



Table XV: Types of Instruments Used 



Type 



Number 



Percent 



1. Achievement Assessments 

2. Survey/ Questionnaire 

3. Affective Inventory 

4. Interviews 

5. Observations 

6. Informal Discussions 

7. Logs 



18 
14 
9 
4 
3 
3 
2 



34.0 
16.9 
16.9 
7.5 
5.7 
26.4 
3.8 



Number = 53 



100% 



Tables XIV and XV show that the most commonly used tests were locally 
developed achievement tests. This reflects the fact that most evaluations 
were performed on a pre-post test results basis. Xfhen available, tests pro- 
duced by publishers were developed (2*^.8% of tests used). In the case of 
many evaluations, surveys and questionnaires were used to obtain perceptual 
information of individuals involved in the program. In some cases, this 
information was the only source of evaluative data. 

The largest lack in the information provided by the CEDISS sites was 
reliability and validity data for the instruments used. Only two sites 
reported information of this nature. It is therefore impossible to determine 
the quality of the instrumentation used. 
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D> Summary 



To summarize the information presented in this report, there are three 
questions that can be asked- The first question is, "What have we learned 
about products;" second question "What have ve learned about the problems 
these products addressed;" and, finally "What have ve 1^^^^^*^ about implemen- 
tation of the products." These questions will be answ^i^ed in the following 
paragraphs. 

A review of the information already presented shows that of the 150 
CEDIiTS products made available to the CEDISS sites, a Ttiinimum of 30 of these 
produ '.ts were used. It is important to know that this is the minimum number 
as the evaluators received information from only 40 diff^^^nt CEDISS sites. 
This leaves six other CEDISS sites unaccounted for. Th^se six sites may have 
used six or more different CEDISS products- Of the products from which infor- 
mation was provided, the most common subject areas were career awareness, 
self awareness, interpersonal skills and decision makinS skills. Students 
were most often instructed through a combination of teacher instruction, work— 
book activities, and small group discussion. While most of the products 
dealt with "awareness type" issues such as the career awareness and self 
awareness, several products dealt directly with job seeking and employability 
skills. Examples of these skills would be the ability correctly read a 
want ad, the job application process, expectations of the potential employer 
during interview and instruction on some of the common foinns that a new 

employee would be expected to fill out. In only one case of all the CEDISS 
products did the teachers, administrators or students indicate dissatisfaction 
with the product. The CEDISS sites were generally itnpt^ssed with the products 
and intended to either try new products in following yesrs or expand upon the 
products that were currently being used, 

A second concern is the relation of the CEDISS products to the problems 
the schools had intended the CEDISS program to address. The vast majority 
of problem statements fell into the category which could be labeled instruc- 
tional problems. Examples of problems that would fall under this category 
are career exploration in the junior high, preparation of all seniors in the 
area of employability, career education infusion, or th^ area of self aware- 
ness. Some of the projects started out with problem statements that can be 
categorized either according to a guidance problem, for example, selecting a 
project or product revolving around guidance services students. A problem 

may also have been in the area of placement. An exampl^ °f ^ placement problem 
is one such as developing a job placement center which would help the students 
not only find a job, but also instruct the students in skills such as reading 
a want ad and filling out appropriate job application £c>rms. 

Within these three categorical areas, the information Summarized indi- 
cated that the overwhelming majority of CEDISS products dealt with the instruc- 
tional category. Tables II and VI indicate that the s^^bject area addressed 
and the intended product outcome were most often of an instructional nature. 
A factor that may have contributed to this is that many of these programs 
were carried out in the middle school or below grade levels where the students 
would not have been as interested In placement service^ or guidance services 
aimed toward selecting an appropriate career as they would be in instructional 
services to help them become more self aware and more career aware. 
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Thus, it is the conclusion of this evaluation that as the majority of 
problems selected by the CEDISS sites indicated a need for instruction in the 
area of career education, thn products made available through the CEDISo 
program met this need and provided a wide enough range of topics for which 
the schools could select their CEDISS product. 

The final question which remains to be answered is what have we learned 
about implementation of the CEDISS products. The information collected indi- 
cated that the average CEDISS product was implemented for twelve weeks or less 
on a schedule of one day a week primarily by a single teacher. This indicates 
that the products selected were selected for implementation on a specific 
target audience. This leads one to believe that successful implementation 
does not necessarily require the involvement of the building administration 
or of district of I.S.D. levels of administration. It should be noted, how- 
ever, that several of the project sites indicated that a factor in the success 
of the program was inVolvement of the building administration in the Imple- 
mentation of the CEDISS product. Involvement on the part of the administra- 
tion will be particularly important if a product that is a complete curriculum 
package is to be implemented. This would also facilitate the implementation 
of training required prior to teacher use of the product. The major weakness, 
however, in the implementation process was the lack of appropriate evaluation 
methodology to determine the impact of the CEDISS products. In many instances, 
the vrrcng instrumentation was selected to properly measure the specified out- 
come of the particular product • Or, if the instrumentation had been correctly 
carried out the results of student performance were not mentioned in the pro- 
duct evaluation reports. It is therefore recommended that, in the future, 
greater care be given to the evaluation aspect of a CEDISS product implementa- 
tion. Without proper evaluation methodology, the Career Education Office will 
not be able to determine which of the CEDISS products currently available are 
worthy of being retained and which should be discarded and replaced by new 
products . 

Finally, the CEDISS program appears to have been a success inasmuch as 
the products addressed the problem areas of the individual schools. The pro- 
ducts were used by the schools in attempt to solve problems and those people 
involved in the use of the products reacted favorably to the overwhelming 
majority of the available CEDISS products. 

The next section of this report is a product by product summary of the 
information presented by the CEDISS sites. The information summarized in- 
cludes a description of the product and how it was used. Implementation infor- 
mation, evaluative methodology and outcomes. 
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Swdry: 

30 dit'ferunt proiiucts used 
51 lotal [jroducLa iistid (site 

pcodactii) 
40 sites reportiiuj data 

CEDISS PRODUCT SUHMARV 





Pact Sheet 


Taryet 


User Information 








I'roducL Name 


Humbur 


Croup 


School 


Size 


Product Focus 


Evaluation Results 


Cost 


1. Careers for Voui 


M 


Fact. 7 - 12 


Churchill High School 


.'1990 


Career Awareness; inter- 


Fre/Post - Control/Treatineiii 


?195.00 


Ufusiyle 




Uijed 11-12 


Livonia Michiyan 


26494 


views with workers. 


Career Planning Knowledge 






Ubed 7,8 


Saginaw Township 
Comiinity Schools 

Jonesville Coiiuiiunity 
Schools 

Norway Dist. 1340 
Dist. 685 


6802 




Test adapted from ACT 
used. No significant dif- 
ference in gain scores 
found between the two 
groups. 




2. KaiKjJioo Kit 




Used 3 and 7 
Fact. K-i2 


Shiawassee l.SJJ. 


Five 
Schools 


Leisure and its relation- 
ship to career explora- 

LiUll ailU UCl^i9iUil IIUlMU^jt 


Pre/Post - Coiitrol/Troatnieni 
Cognitive Skills Test (60 

affective measure test 
(10 items, no additional 
data) significant difference 
in favor of the treaUnent 
group. 

Comments: Difficult to 
integrate time consuming 
to plan. 


? 75.00 


3. Job AllOdd; A 




Fact. 7-adult 


Ueckerville 


1140 


Career Awareness with 


Pre/Post - Control/'freatJiienl 


Specimen Set 


ilut'uut kfddiny Stiiies 

"8 




Used Oth 


Cojiiiiiunity 




emphasis in basic reading 
skills. 


Teacher develoj^ed test 
based on curriculum content 
KR21 = .04. Significant 
uiiicicnLc in lavui ui uie 
treatment group. 


$20.95 

■ 1 
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Cm<S PKODUCT SUMI^HV 



PruducL Name 


Tact iiliiict 
Nuinber 


Tanjtit 
Group 


User InforiMtiori 


Product Kocus 


Evdluaiion HusuUs 


_Cub^ 




Size 


1. Findini] Vour FirsL 
Job 


162 


KdcL. 7-10 
Used 9 


Lakeview lligli 
School 


655 

District 
2041 


Skills to aid in finding 
a first job and keeping 
it. 


Lakeview found significdnt 
differences in favor of 
treatjuent on a pre/[ost 
control/ treatment d^isiyn 
using the klmploynient 
Preparation Survey. Sub- 
stantial control/treatinent 
group differences on the 
pre- test measure laake the 
validity of results 
questionable. 


Macjic Circlo 


214 


Pre-school-6 
Used Head' 
st^rt-fiftli 


Duffield - Detroit 
Public Schools 

Mason County Central 
Schools 


Duff. 545 
District 

District 
3;65 


Self awareness and inter- 
personal skills. 


Duffield - "Program suc- 
cessful in ttiriiis of our 
objectives". No su]^[)0rt- 
in(j data, 

Mason - No iafofination. 


5103. UO 


), Vdluiny Ap]Jiodch l.u 
Career Kducdtioii 


22^ 


na, 3-5 
Used 5th 


Addison Coiiuiiunity 
Schools 

Port Huron Area- 
Lake()ort School 


Conun, 
1590 

Lakeport 

295 
District 
13929 


Personal values^ job 
satisfaction, life roles 
and concept of change. 


Locally developed test 
used in pre-ix3St control/ 
treatment design, No test 
data or statistical 
analysis performed. Treat- 
ment group sitowed inore of 
a positive trend tlian ■ 
control, 

fun nuron iio inioiiiia 
tion. 


$499.95 


h ValuiiKj Approach to 
Ccircer Education 
(K-21 

^11^ 


225 


i'^act. K-2 
Uaed K-2 


Port Huron Area 
Lakeix3rt School 


lakeport 
295 

Dist» 
13929 


Self-awareness ; awareness 
of otliers, career aware- 
ness. 


No evaluation results 
reported. Tested students 
using test included in 
package, Also administered 
locally develoiied [larent 
teacher surveys. 


$347.50 
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(.'EDISS I'HODUCT SUMMARY 



I'luJiicL lUiiie 




Tanjet 
(iroiip 


lliiur Informat 
School 


ion 

Size 


Product Focus 


Fvalnatioii toults 


Cost 


II. FreusLyl-j 

1 Aiipulachian Lducutiorr 
al Laborutoiy: Career 
IiituiiiuLiuii SyijLeiii 

tllkl l:X|^loillliJ CiU'tiL-r 
lJOCL:aU;il MukilHJ 

10. Career Awarenuss 
EK|»LoraLiun Kit 




Fact; 3-12 
Used 6 and 7 


Bay City Public 
School:) 


Dist. 

13010 


Career Awareness^ self- 
awareness ' breakdown 
of role stereotyping by 
sex. 


ibK Study iinuerway pre/[xjsc 
control/tredtiiient design 
utilized. No significant 
differences found between 
tlie two. Validity of study 
questioiinable due to treat- 
ment group not viewing the 
entire series. 


(iACii nn 


2)1 


Fact. 

Secondary 
Used 8-11 


Freinont Jr. lliyh 

Fowlerville Coiioiu 

Ironuois Middle 
(Grand Rapids) 
hIc] Hav de Mdc 

L'Anse Creuse 


Dist. 2550 

Dist. 2250 

Dist. 36208 
Ire. 905 

Dist. 


Career exploration, self- 
exploration, career- 
decision inakiny and career 
planning. ' 


Pre/ix)st testing, (iains 
not statistically analyzed. 
It appeared thdt student 
skills at the end of the 
prograoi were better than 
ineir bniiib dt cne Dogin" 
ning of the program. 


Prices may 
be purchased 
separately. 

Total Cost 


m 


Fact. Grades 
^8 


Bangor Middle School 
Van Buren I.S.D. 


Dist. 1800 


Career awareness, attitudes 
toward work and work re- 
lated activities. 


Pre/post control/treatnient 
design used. 1'eacher survey 
administered. No results 
given* 


In Oregon: 
?49.95 

Outside: 
$5196 


11. Career l)cvelu[jiiii:n(: 
Centered Curriculum 
(Cokti huject) 


124 


Fact sheet: 
K-6 


Pennfield 

Coinstock 

Inland Lakes 

Hale Area 

Ionia 

Bedford 

Feniiville 


Dist, 

Dist. 2932 
Dist. 
Dist. 810 
Dist. 3285 
Dist. 

Dist. 1825 


Salf awarenesS; goal 
setting, roles people 
have in society, career 
awareness. 


lias JDRP d[)proval. 

1 


?50.00 total 
$ 2.00 per 
unit 

'J 3 
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CliDISS PHODUCT SlIHHAKY 





\\\cX Sheet: 




Ubur liifonnatioii 








Pioducl Name 


Niifnbcr 




School 


Size 


Product Focus 


Kvahijtiun Hesnlls 




12. bmploydbility Skills 




Fact Sheet: 
Secondary 


Lewis Cass I.S.D. 

Cop[jer County I.S.D. 
Big Bay de Noc 

Coiiunuriity 
Benton Harbor 




SKiiis necesisdry to ytit 
and keep a job. 


une scnoui aeveioptu an 
instruiiient to measure stu- 
dents skills during an 
inLerview. rie/pusL uebigiu 
No statistical analysis 
perfomied although a slight 
gain in the skill was re- 
ported. 


?5,U0 

T,l». Sheet 
(jriides 
$10.U() 
(teacher) 


13. Exploriny Caioei'i) 


159 


8th yrade 


NoMy 


Dist. 8B5 


Awareness of career ed. 
and self-awareness. 


No data re[>ortcd, 


No d^'d 
reported. 


14, first Jobb 


^1)5 


Secondary 


Glen Lake 

Saginaw Township 
Coiiuiiiinity Schools 


Dist. 6802 


Practical job applica- 
tions skills. 


Pre/post test control/treat- 
ment design. Locally 
developed cognitive skills 
test used. No significant 
differences found. 
Validity of instrument 
questionnable. 


Module J and 
II 

coiiiliined 

5159.00 
separately 

5 90.00 


15. Cettiiitj it Totjetlitir 
Reading Series 
ab<)ut Peuplo 


197 


7th adult 


DeckerviUe Coiiun. 
Schools 


Dist. 11.10 


Improvement of basic 
reading skills and career 
awareness/self-awareness 
tlirough stories presented. 


No information available. 

c; 


Sample set 
$19.70 
Level I 

54.15 
n - 54.15 
III - 54.15 
Teacheis 
yrade 52.30 
Answer Key 

m 



84 

o 

ERIC 



CEDISS I'KODDCT SUMMAIW 



huJiicL Name 


iJiiitiiei' 


Tanjet 


User Inforioation 


Product Focus 


Evaluation Results " 


Cost 


School 


Size 


16. \iooty Goes Lu Wuck 




n\\ diid Bth 

I'act: 
Secondary 


Saginaw Township 
Cominanity Schools 


Dist. 6802 


Career awareness/ job 
seeking skills. 


Locally developed test ad- 
ministered on a pre/[x)st 
schedule. Interviews con- 
ducted post. Formal 
statistical analysis not 
conducted ''froi^ct seems 
to create a willingness on 
the part of the student to 
accept the traditional 
academic subject matter as 
a method of achieviiiy 
career goals and future 
employment" Product needs 
supplementary iiiateiials to 
achieve maximum effect. 


5119.00 


17. Ilctllh: Docisioiiii 
tor Grow til 


112 


l-'act: 5th 

and 6th 
Used at 

7th and Bth 
grade 


Addison Conununity 
Schools 

Burton Junior High 
(Grand Rapids) 


Dist. 1590 

Burton 864 
Dist. 3620t 


Physical fitness, environ- 
mental health, and 
anatomy. 


Pre/post desi^jn and test 
items provided in product 
used in both schools. 
Statistical analysis nut 
performed. However, in 
both cases post- test scores 
were higher than pre-test 
scores. 


Texts: 

Level 5 55.79 
Level 6 56.24 
Resource Book 
$3,00 each 
level film/ 
cassette/ 
teachers 

54B.00 level 
Test Booklet 

]5t each 


li). liiicicliainju 
utjJcs 10-12 


IGl 


Grades 10 - 
12 


Mason County 


Dist. 3565 


Self awareness, inter- 
personal skills. 


No information presented. 


5159.95 . 


19. InttMvhaiuje 

56 




Grades 7-9 


Mason County 


Dist. 3565 


Self-awareness, inter- 
personal skills. 


No information presented. 


5159.95 

Or/ 
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CEDISS PkODUCT SlJMMAIiy 



huducL Ni.iins 


I'act Sheet 
Number 


Tanjet 
Group 


Uber liifouitation 


Product Focus 


Evaluation hesu! Ls 


^CosL 


School 


Size 


20, JusL He Book 


lOli 


1st yrdde 


Lake City Schools 


Dist. 1200 


Student self-awareness. 


Pre/Post administration of 
the Self-Concept AssessinenJ: 
Inventor (Robert Koelis, 
Marquette Alqer I.S.D.l No 
significant difference 
found. 


$b.5(J for 

teacliers 

guide. 


21. Me aiidOLliers 


15b 


Fact Sheet: 
7-10 
Used: y 


Ldkeview High School 
Addison CuMnity 


Dist. 2041 
U.S. 655 
Dist. 1590 


Self-awareness and self- 
csteeoi. 


This school used a pre/[)()St 
multiple measure design. 
No significant difference 
found. Addisoiis evdluation 
utilized a pre/[x)st assess- 
ment with a vocabulary 
nieasure. Instrumentation 
caused the evaluation to be 
judged non-valid. 


[2 workbooks 

dliu LOainei 

measure 
(^34.U0) 


22. Hy Bread diid Butter- 
flies Career Book 


1135 


Fact: 4-5' 
Used: 3-6 


Lakeview School 




Interaction of personal 
interests and job 
characteristics, job 
awareness, self -aware- 
ness. 


The school used a sex- 
stereotyping scale on a 
pre/post measure. The 
product had very little 
to do with sex-stereogyping 
Therefore, the evaluation 
results are of questionable 
validity. No significant 
differences found. 


$1.50 

leuLiiei 
$1.50 

sliideiit 


23. I'roject Hear 


243 


^'act: 4-12 


Bad Axe Public 
lijcnooib 


Dist. 1726 


SeU-awareness, sex-role 
stereotyping, occupation- 
al interests, decision 
making strategies. 


Product has JDkP approval. 
« 


Primary 
level 

559.45 
Int. 

$50.08 
Secondary 

$86.24 



CEDISS PRODUCT SUHHAliy 



['roJuct Njirtti 


I'dCt Shtel 
Huiiibiir 


Tarijet 
Group 


User IntoriDdtion 


Product Focus 


Evaluation Hesiilts 


Cost 


School 


Size 


24. ACT Cjieer l^luniiini) 
ho^rain Product 


217 


11th grade 


Houghton Lake 
Coiiununity Schools 


nist, 1871 


Career decisions based 
\i\m test results. 


Evaluation data not yet 
available. 


No info. 


25. Circer /Iwattiness: 
H (Texas Education 
Avjciicy) 


No fact sheet 


Grades 1-b 


Tahquemenon Public 
Schools 




Development of conceptual 
areas in career education. 


Locally developed Career 
Education Cognitive Skills 
Test. Administered pre/ 
[jost - no control. Sig- 
nificant difference for 
grades 1 and 3. Not 
significant but [)ositive 
grades 4 and 6. Slight 
decrease grade 5. 


No info. 


2b. Duso Kit 

(Dcvelopiiiij under- 
sundiinj cf aelf and 
others) 




1st grade 


Addison Coiiuounity 
Schools 


Dist. 1590 


Self-awareness and aware- 
ness of others, 


Pre/post admiiiistration of 
a survey instrument and 
student self-kept behavior 
log. No statistical 
analysis were perforiiiud 
and no evaluation data 
reported. 


No info. 


27. htit Lo bo You and 
Me 


17'1 




Alnia/llillcrest 
tllenientary 


Dist. 3413 
School 339 


Self-awareness and awjre- 
ness of others. 


Post only - teacher ques- 
tionnaire and objective 
measure test. No data 
reported. Stated that 
"students had a hi'jh de- 
gree of group succesi;". 
No supporting data. 


5160.00 


28. Untitled: I'lU- 
roiiiisite skills for 
vocjtional education 

^' 1 




Assumed 
Secondary 


Gogebic-Ontonacjon 
I.S.D. 




Identification and develop 
ment of prerequisite 
skills objectives for pre- 
vocationd education 
classes and then iiiiple- 
mentation of the objec- 
tives. 


" Success measuied by student 
performance in following 
year's vocational classes. 
Vocational teachers indi- 
cated students were better 
prepared. Ho re emphasis 

needed in basic skills! No 
sup[)orting data. 


No info. 

91 



ERIC 



iiDiiis PkODUcr liumiiv 



iil. ScoU I'oryuiiuii 
Series 



JO. Careers: ^ 
plenitjiital KcddiiKj 
I'loyriiiii 



09 



Fill I SliKLl 
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T.ii'jel 

K-8 



grade 



IJ^jcr lafoKiiatiud 



Schoul 
Maple VdUoy 



Hurway 



Dist. B85 
School 211 



irdpruvemeiiL of redding 
iikilis. 



To develop self-awateness, 
career awareness and 
career education knowkdue 



t:v,iliiat.iu(. k-snlU 



Very little iiiforiit.it iuii 
availublo. ScliOiil vidiiU-d 
lO compare tliib product 
with an iinidentifiefJ -jeoond 
score. Tericlier'ii received 
the pruriuct favorably ae- 
cordih^j to a cecichei 
(|ijestioniiaire. (lio 
iiupportiny data J 



No evaUidlion. 



infu, 



No info, 



